-- Logs begin at Thu 2021-11-11 19:55:15 UTC, end at Thu 2021-11-11 20:56:58 UTC. -- Nov 11 20:29:36.318503 dv-cinder-817642-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 11 20:29:36.328370 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Nov 11 20:29:36 2021] *** Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: nodename: dv-cinder-817642-1-iscsi Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: machine: x86_64 Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: clock source: unix Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: pcre jit disabled Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: detected number of CPU cores: 4 Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: current working directory: / Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: detected binary path: /usr/bin/uwsgi-core Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: your processes number limit is 47680 Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: your memory page size is 4096 bytes Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: detected max file descriptor number: 2048 Nov 11 20:29:36.329654 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: lock engine: pthread robust mutexes Nov 11 20:29:36.330914 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: thunder lock: enabled Nov 11 20:29:36.330914 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 11 20:29:36.330914 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 11 20:29:36.373529 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: Python main interpreter initialized at 0x5645f781d9c0 Nov 11 20:29:36.373529 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: python threads support enabled Nov 11 20:29:36.373529 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: your server socket listen backlog is limited to 100 connections Nov 11 20:29:36.373529 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: your mercy for graceful operations on workers is 90 seconds Nov 11 20:29:36.373925 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: mapped 403077 bytes (393 KB) for 2 cores Nov 11 20:29:36.373925 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: *** Operational MODE: preforking *** Nov 11 20:29:36.374195 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: *** uWSGI is running in multiple interpreter mode *** Nov 11 20:29:36.374195 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: spawned uWSGI master process (pid: 101107) Nov 11 20:29:36.374402 dv-cinder-817642-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 11 20:29:36.379998 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: spawned uWSGI worker 1 (pid: 101108, cores: 1) Nov 11 20:29:36.379998 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: spawned uWSGI worker 2 (pid: 101109, cores: 1) Nov 11 20:29:36.379998 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 11 20:29:38.043528 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 20:29:38.043528 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: from cryptography.utils import int_from_bytes Nov 11 20:29:38.044126 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 20:29:38.044126 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: from cryptography.utils import int_from_bytes Nov 11 20:29:38.049187 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 20:29:38.049187 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: from cryptography.utils import int_from_bytes Nov 11 20:29:38.049888 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 20:29:38.049888 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: from cryptography.utils import int_from_bytes Nov 11 20:29:40.602314 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 20:29:40.602887 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 20:29:40.603054 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 20:29:40.603416 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 20:29:40.603674 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 20:29:40.604090 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.604421 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.604749 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.605074 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.605406 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.605660 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 20:29:40.606013 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.606102 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 20:29:40.606192 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.606342 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.606435 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 20:29:40.606675 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.606786 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 20:29:40.606930 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.607028 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 20:29:40.607254 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.607352 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.607580 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817642-1-iscsi {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.607673 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.607902 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.608015 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.608261 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.608347 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.608576 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.608682 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.608956 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.609043 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.609557 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.609664 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.609738 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.609811 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.609882 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.609951 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.610168 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.610383 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.610497 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.611659 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.611770 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817642-1-iscsi {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.611845 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.611845 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.612012 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.612096 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.612163 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.612231 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.612294 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.612513 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.612601 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.612826 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.612930 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.613137 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.613233 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.613469 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.613659 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.613853 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.614030 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.614222 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817642-1-iscsi {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.614407 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.614628 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.614820 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.615008 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.615196 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.615349 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.615560 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.615751 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.615906 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.616136 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.616318 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.616479 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.616710 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.616710 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.616974 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.617096 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.617251 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.617382 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.617514 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.617514 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.617768 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817642-1-iscsi {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.617928 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.618052 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.618172 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.618293 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.618424 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.618544 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.618703 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.618831 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.618953 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.619082 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.619215 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.619369 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.619489 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.619608 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.619739 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.619859 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.620046 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.620193 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.620325 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.620522 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.620645 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.620842 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.620974 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.621160 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.621290 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.621479 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.621606 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.621766 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.621932 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.622085 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.622214 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.622334 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.622466 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.622633 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.622766 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.622945 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.623070 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.623246 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.623377 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.623499 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.623625 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.623786 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.623918 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.624133 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.624268 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.624452 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.624578 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.624772 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.624895 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.625026 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.625146 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.625266 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.625387 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.625554 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.625688 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.625872 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.625999 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.626177 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.626358 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.626598 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.626839 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.627229 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.627366 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.627524 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.627658 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.627838 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.627994 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.628178 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.628304 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.628489 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.628622 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.628798 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.628936 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.629119 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.629245 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.629436 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.629561 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.629758 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.629894 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.630066 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.630271 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.630395 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.630517 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.630686 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.630825 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.631003 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.631138 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.631308 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.631434 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.631553 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.631680 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.631849 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.632001 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.632187 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.632313 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.632508 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.632644 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.632818 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.632951 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.633128 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.633253 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.633437 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.633563 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.633738 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.633864 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.634046 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.634173 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.634355 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.634487 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.634662 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.634788 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.634908 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.635027 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.635201 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.635327 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.635506 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.635632 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.635824 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.635958 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.636155 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.636292 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.636461 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.636587 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.636765 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.636899 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.637089 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.637248 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.637372 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.637493 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.637653 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.637787 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.637960 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.638085 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.638264 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.638391 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.638569 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.638703 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.638870 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.639003 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.639175 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.639300 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.639477 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.639609 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.639778 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.639904 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.640111 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.640237 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.640439 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.640573 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.640723 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.640848 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.641025 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.641156 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.641354 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.641478 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.641599 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.641719 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.642456 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.642588 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.642882 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.643017 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.643139 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.643366 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.643498 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.643670 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.643803 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.643994 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.644122 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.644305 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.644441 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.644612 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.644751 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.644918 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.645043 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.645223 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.645355 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.645594 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.645739 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.645862 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.645982 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.646139 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.646265 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.646447 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.646581 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.646751 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.646882 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.647057 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.647211 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.647361 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.647493 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.647664 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.647791 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.647985 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.648113 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.648294 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.648430 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.648598 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.648725 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.648901 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.649027 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.649200 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.649333 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.649516 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.649641 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.649836 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.649962 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.650143 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.650268 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.650453 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.650573 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.650761 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.650872 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.651076 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:29:40.651175 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.651410 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.651508 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.651733 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.651838 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.652075 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.652174 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.652402 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.652501 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.652718 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.652823 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.653036 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.653170 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.653350 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.653475 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.653660 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.653786 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.653971 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.654103 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.654296 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.654444 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.654603 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.654737 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.654913 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.655040 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.655222 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.655347 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.655536 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.655750 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.655876 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.656011 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.656190 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.656317 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.656508 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.656634 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.656823 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.656948 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.657140 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.657272 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.657451 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.658187 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.658458 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.658720 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.658846 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.659101 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.659239 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.659416 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.659541 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.659737 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.659861 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.660083 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.660226 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.660404 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.660612 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.660740 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.660861 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.660990 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.661119 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.661295 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.661421 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.661605 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.661730 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.661912 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.662039 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.662233 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.662360 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.662560 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.662685 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.662867 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.662993 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.663195 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.663319 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.663499 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.663624 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.663810 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.663937 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.664150 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.664275 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.664457 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.664662 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.664784 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.664905 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.665067 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.665192 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.665372 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.665510 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.665683 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.665822 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.665991 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.666116 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.666297 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.666429 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.666621 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.666751 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.666927 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.667050 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.667230 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.667364 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.667546 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.667672 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.667857 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.667999 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.668193 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.668320 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.668500 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.668627 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.668812 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.668943 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.669124 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.669248 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.669431 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.669554 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.669755 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.669856 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.670068 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.670157 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.670373 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.670467 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.670692 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.670779 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.671000 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.671094 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.671306 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.671399 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.671610 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.671703 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.671922 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.672046 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.672257 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.672350 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.672564 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.672663 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.672871 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.672958 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.673284 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.673727 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.673940 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.674037 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.674121 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.674223 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.674403 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.674561 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.674711 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.674882 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.675049 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.675213 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.675357 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.675540 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.675693 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.675860 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.676027 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.676195 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.676347 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.676512 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.676664 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.676822 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.676965 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.677129 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.677271 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.677438 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.677590 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.677750 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.677892 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.678056 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.678200 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.678362 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.678513 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.678670 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.678812 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.678975 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.679124 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.679268 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.679419 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.679573 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.679783 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.679923 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.680099 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.680248 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.680389 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.680531 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.680666 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.680807 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.680943 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.681110 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.681254 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.681402 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.681536 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.681742 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.681897 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.682070 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.682211 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.682384 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.682525 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.682688 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.682837 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.683005 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.683146 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.683321 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.683474 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.683633 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.683788 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.683946 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.684109 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.684279 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.684422 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.684594 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.684754 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.684897 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.685031 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.685207 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.685350 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.685521 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.685671 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.685831 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.685979 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.686142 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.686282 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.686452 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.686601 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.686767 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.686915 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.687072 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.687212 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.687383 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.687542 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.687720 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.687867 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.688077 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.688220 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.688398 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.688542 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.688721 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.688869 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.689375 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.689519 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.689811 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.689933 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.690159 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.690253 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.690472 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.690562 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.690790 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.690889 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.691114 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.691209 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.691425 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.691531 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.691737 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.691835 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.692075 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.692166 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.692385 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.692485 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.692693 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.692781 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.693004 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.693099 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.693320 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.693413 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.693626 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.693713 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.693936 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.694026 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.694244 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.694413 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.694560 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.694653 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.694870 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.694957 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.695177 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.695272 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.695485 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.695581 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.695797 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.695883 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.696139 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.696248 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.696447 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.696539 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.696751 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.696836 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.697057 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.697144 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.697369 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.697454 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.697672 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.697771 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.697985 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.698091 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.698291 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.698382 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.698595 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.698680 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.698896 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.698989 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.699202 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.699296 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.699505 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.699602 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.699808 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.699900 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.700142 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.700240 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.700464 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.700564 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.700774 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.700867 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.701085 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.701177 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.701402 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.701498 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.701705 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.701789 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.702010 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.702095 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.702332 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.702424 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.702640 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.702724 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.702945 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.703037 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.703250 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.703336 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.703553 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.703646 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.703863 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.703948 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.704204 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.704294 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.705084 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.705193 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.705438 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.705659 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.705755 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.705996 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.706083 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.706318 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.706423 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.706634 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.706730 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.706948 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.707041 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.707261 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.707520 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.707620 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.707856 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.707950 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.708201 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.708291 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.708513 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.708612 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.708825 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.708911 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.709135 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.709228 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.709445 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.709540 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.709770 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.709862 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.710083 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.710174 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.710393 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.710485 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.710702 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.710793 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.711007 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.711091 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.711314 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.711401 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.711627 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.711713 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.711934 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.712210 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.712307 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.712544 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.712637 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.712862 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.712997 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.713166 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.713259 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.713472 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.713559 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.713797 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.713881 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.714111 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.714209 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.714426 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.714514 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.714731 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.714817 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.715040 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.715131 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.715342 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.715428 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.715645 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.715731 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.715951 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.716170 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.716298 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.716431 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.716585 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.716669 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.716891 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.716990 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.717196 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.717282 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.717507 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.717592 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.717811 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.717910 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.718113 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.718244 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.718460 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.718565 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.718768 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.718872 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.719084 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.719179 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.719387 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.719483 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.719699 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.719785 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.720622 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.720754 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.720939 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.721250 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.721343 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.721557 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.721681 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.721860 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.721997 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.722172 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.722311 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.722484 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.722623 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.722794 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.722971 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.723102 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.723284 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.723405 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.723627 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.723721 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.723963 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.724076 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.724330 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.724428 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.724639 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.724723 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.724941 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.725034 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.725244 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.725339 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.725568 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.725660 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.725879 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.726091 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.726189 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.726408 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.726543 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.726781 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.726866 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.727087 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.727383 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.727470 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.727697 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.727936 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.728045 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.728350 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.728512 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.728654 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.728966 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.729051 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.729347 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.729652 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.729750 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.729962 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.730211 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.730297 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.730561 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.730656 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.730879 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.731131 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.731230 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.731481 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.731576 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.731790 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.731889 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.732114 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.732206 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.732431 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.732520 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.732737 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.732828 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.733041 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.733145 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.733346 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.733436 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.733657 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.733747 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.733965 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.734054 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.734267 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.734365 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.734581 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.734671 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.734888 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.734977 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.735190 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.735293 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.735514 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.735604 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.735950 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.736287 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.736374 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.736594 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.736706 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.736914 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.737002 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.737225 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.737320 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.737534 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.737623 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.737841 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.737928 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.738146 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.738239 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.738458 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.738545 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.738762 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.738854 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.739068 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.739162 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.739372 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.739456 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.739679 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.739763 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.740028 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.740134 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.740309 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.740396 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.740612 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.740698 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.740915 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.741072 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.741219 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.741306 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.741541 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.741634 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.741850 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.741938 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.742153 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.742238 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.742456 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.742541 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.742756 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.742844 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.743085 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.743170 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.743389 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.743479 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.743695 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.743782 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.744023 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.744125 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.744351 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.744438 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.744666 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.744761 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.744980 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.745066 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.745285 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.745378 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.745607 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.745767 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.745915 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.746009 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.746221 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.746315 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.746532 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.746616 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.746847 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.746933 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.747152 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.747251 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.747455 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.747541 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.747762 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.747853 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.748096 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.748198 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.748407 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.748579 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.748718 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.748803 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.749031 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.749130 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.749394 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.749640 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.749640 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.749785 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.749930 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.750051 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.750238 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.750364 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.750547 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.750672 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.750857 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.750998 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.751479 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.751666 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.751774 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.751867 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.752136 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.752329 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.752414 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.752643 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.752727 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.752951 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.753049 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.753262 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.753388 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.753570 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.753701 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.753884 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.754016 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.754196 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.754323 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.754503 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.754635 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.754831 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.754947 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.755144 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.755263 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.755449 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.755578 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.755768 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.755884 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.756097 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.756329 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.756416 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.756649 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.756738 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.756963 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.757116 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.757276 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.757429 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.757582 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.757742 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.757885 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.758047 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.758197 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.758359 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.758521 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.758671 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.758828 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.758988 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.759132 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.759303 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.759438 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.759608 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.759761 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.760052 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.760143 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.760366 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.760503 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.760676 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.760811 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.760983 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.761124 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.761289 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.761431 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.761592 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.761851 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.761939 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.762168 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.762263 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.762483 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.762569 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.762790 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.762936 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.763093 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.763189 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.763415 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.763509 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.763719 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.763806 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.764058 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.764146 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.764372 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.764458 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.764695 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.764780 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.765018 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.765107 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.765330 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.765466 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.765644 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.765784 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.765949 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.766096 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.766271 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.766417 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.766599 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.766738 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.767427 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.767670 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.767844 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.768176 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.768268 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.768501 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.768590 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.768812 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.768898 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.769136 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.769223 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.769463 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.769550 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.769768 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.769854 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.770071 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.770157 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.770382 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.770494 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.770687 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.770775 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.770993 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.771086 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.771316 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.771443 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.771621 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.771708 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.771933 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.772080 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.772272 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.772385 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.772581 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.772698 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.772884 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.773022 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.773192 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.773348 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.773514 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.773655 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.773820 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.773961 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.774144 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.774273 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.774459 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.774577 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.774780 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.774886 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.775101 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.775196 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.775409 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.775495 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.775731 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.775817 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.776066 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.776200 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.776377 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.776466 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.776684 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.776769 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.776990 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.777087 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.777313 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.777397 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.777618 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.777703 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.777941 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.778026 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.778255 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.778342 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.778577 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.778669 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.778884 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.778977 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.779192 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.779276 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.779514 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.779599 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.779825 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.779913 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.780157 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.780278 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.780462 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.780557 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.780766 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.780852 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.781105 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.781197 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.781412 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.781550 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.781736 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.781822 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.782039 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.782125 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.782346 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.782443 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.783198 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.783481 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.783570 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.783826 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.783921 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.784199 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.784311 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.784519 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.784638 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.784841 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.784937 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.785166 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.785255 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.785472 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.785565 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.785777 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.785872 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.786089 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.786176 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.786394 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.786480 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.786704 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.786799 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.787008 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.787095 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.787319 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.787404 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.787622 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.787716 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.787926 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.788059 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.788255 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.788342 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.788578 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.788666 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.788882 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.788968 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.789205 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.789299 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.789515 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.789603 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.789818 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.789906 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.790122 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.790208 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.790423 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.790511 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.790766 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.790908 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.791073 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.791169 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.791395 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.791483 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.791711 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.791796 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.792051 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.792152 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.792375 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.792462 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.792688 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.792926 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.793018 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.793259 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.793346 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.793574 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.793660 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.793889 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.794014 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.794205 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.794293 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.794514 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.794599 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.794829 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.794921 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.795140 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.795225 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.795452 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.795538 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.795764 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.795858 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.796103 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.796250 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.796422 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.796515 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.796749 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.796969 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.797085 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.797299 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.797422 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.797615 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.797743 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.797929 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.798062 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.798431 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.798518 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.798751 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.799017 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.799151 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.799350 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.799438 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.799670 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.799764 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.800003 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.800095 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.800323 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.800409 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.800637 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.800724 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.800951 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.801038 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.801265 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.801419 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.801580 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.801676 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.801894 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.801982 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.802208 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.802294 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.802520 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.802619 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.802833 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.802918 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.803147 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.803239 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.803473 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.803569 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.803802 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.803888 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.804142 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.804241 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.804458 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.804545 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.804771 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.804858 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.805084 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.805175 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.805395 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.805599 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.805706 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.805916 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.806003 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.806249 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.806338 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.806576 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.806662 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.806906 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.806992 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.807217 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.807303 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.807533 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.807619 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.807858 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.807945 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.808190 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.808278 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.808497 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.808591 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.808810 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.808906 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.809123 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.809230 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.809432 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.809525 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.809752 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.809941 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.810066 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.810254 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.810373 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.810586 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.810694 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.810909 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.810996 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.811232 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.811523 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.811610 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.811850 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.811947 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.812199 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.812294 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.812503 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.812589 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.812808 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.812896 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.813120 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.813212 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.813429 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.813523 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.813782 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.813878 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.814360 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.814522 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.814666 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.814987 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.815082 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.815302 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.815390 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.815610 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.815697 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.815917 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.816050 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.816258 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.816469 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.816557 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.816822 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.816917 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.817141 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.817237 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.817463 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.817550 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.817786 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.817880 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.818092 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.818178 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.818401 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.818486 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.818711 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.818806 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.819018 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.819110 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.819324 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.819408 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.819630 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.819725 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.819937 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.820075 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.820268 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.820356 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.820576 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.820665 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.820879 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.820971 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.821189 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.821273 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.821492 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.821578 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.821802 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.821886 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.822106 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.822191 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.822420 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.822507 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.822724 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.822809 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.823029 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.823121 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.823334 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.823422 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.823637 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.823721 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.823937 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.824070 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.824266 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.824354 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.824573 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.824659 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.824879 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.824974 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.825190 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.825277 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.825495 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.825581 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.825806 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.825900 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.826114 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.826358 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.826445 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.826735 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.826821 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.827048 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.827142 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.827355 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.827441 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.827734 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.827848 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.828066 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.828157 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.828379 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.828466 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.828689 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.828788 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.829017 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.829104 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.829332 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.829914 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.830157 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.830398 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.830560 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.830713 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.830877 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.831063 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.831194 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.831386 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.831510 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.831825 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.831922 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.832168 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.832333 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.832484 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.832657 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.832827 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.833000 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.833149 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.833340 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.833470 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.833649 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.833788 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.833957 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.834108 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.834266 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.834420 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.834590 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.834733 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.834903 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.835043 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.835215 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.835353 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.835528 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.835671 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.835842 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.836023 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.836185 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.836342 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.836496 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.836651 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.836807 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.837072 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.837167 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.837396 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.837489 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.837721 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.837809 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.838049 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.838137 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.838363 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.838454 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.838681 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.838780 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.838999 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.839085 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.839310 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.839396 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.839620 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.839714 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.839931 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.840034 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.840264 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.840350 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.840580 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.840681 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.840909 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.840996 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.841222 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.841308 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.841527 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.841615 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.841831 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.841942 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.842137 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.842255 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.842448 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.842576 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.842783 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.842896 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.843100 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.843328 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.843423 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.843656 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.843749 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.844017 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.844109 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.844313 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.844402 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.844638 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.844731 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.844952 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.845106 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.845430 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.845520 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.845749 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.846040 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.846182 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.846376 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.846500 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.846707 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.846802 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.847019 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.847106 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.847328 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.847423 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.847643 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.847729 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.847957 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.848065 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.848316 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.848405 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.848633 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.848726 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.848955 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.849042 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.849267 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.849355 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.849595 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.849680 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.849905 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.849990 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.850223 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.850309 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.850538 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.850625 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.850852 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.850945 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.851165 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.851252 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.851483 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.851569 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.851796 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.851890 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.852129 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.852218 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.852489 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.852593 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.852756 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.852853 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.853068 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.853154 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.853379 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.853465 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.853707 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.853796 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.854033 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.854117 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.854338 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.854422 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.854665 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.854753 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.854980 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.855067 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.855301 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.855395 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.855616 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.855711 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.855929 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.856035 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.856264 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.856349 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.856511 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 20:29:40.856600 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.856923 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.857237 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.857554 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.857870 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.858188 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.858515 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.858839 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.859162 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.859488 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.859830 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.860182 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.860527 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.861686 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.862183 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.862502 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.862814 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:29:40.863060 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 20:29:40.880056 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_db.sqlalchemy.engines [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:29:40.885567 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG oslo_db.sqlalchemy.engines [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:29:40.948826 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.context [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f28bff3-30b2-4836-a432-daa68ea6bc82(cell1) {{(pid=101109) load_cells /opt/stack/nova/nova/context.py:464}} Nov 11 20:29:40.953061 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:29:40.955235 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:29:40.956089 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:29:40.956748 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.context [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f28bff3-30b2-4836-a432-daa68ea6bc82(cell1) {{(pid=101108) load_cells /opt/stack/nova/nova/context.py:464}} Nov 11 20:29:40.958469 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:29:40.960958 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG oslo_concurrency.lockutils [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:29:40.962561 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG oslo_concurrency.lockutils [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:29:40.963389 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG oslo_concurrency.lockutils [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:29:40.965880 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG oslo_concurrency.lockutils [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:29:40.968993 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_db.sqlalchemy.engines [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:29:40.975301 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_db.sqlalchemy.engines [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:29:40.979273 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG oslo_db.sqlalchemy.engines [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:29:40.981514 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG oslo_db.sqlalchemy.engines [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:29:41.240728 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG oslo_db.sqlalchemy.engines [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:29:41.243469 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_db.sqlalchemy.engines [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:29:41.586000 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: WARNING keystonemiddleware.auth_token [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 20:29:41.592558 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: WARNING keystonemiddleware.auth_token [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 20:29:41.592745 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: WARNING keystonemiddleware.auth_token [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 20:29:41.600179 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: WARNING keystonemiddleware.auth_token [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 20:29:41.820559 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: WARNING keystonemiddleware.auth_token [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 20:29:41.825714 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: WARNING keystonemiddleware.auth_token [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 20:29:41.831312 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5645f781d9c0 pid: 101108 (default app) Nov 11 20:29:41.831748 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: WARNING keystonemiddleware.auth_token [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 20:29:41.833397 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:29:41.834552 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Nov 11 20:29:41.834962 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Thu Nov 11 20:29:41 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:29:41.837032 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: WARNING keystonemiddleware.auth_token [None req-da758215-3fd6-4e92-a59d-69e608a8947a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 20:29:41.842278 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5645f781d9c0 pid: 101109 (default app) Nov 11 20:31:04.437858 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:04.438849 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Nov 11 20:31:04.439263 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:31:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:31:05.053350 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-f5ae3bf3-2fb3-4bd9-bfad-9f4ef7aac6cd admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:05.087764 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-f5ae3bf3-2fb3-4bd9-bfad-9f4ef7aac6cd admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.638930 Nov 11 20:31:05.090297 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1291 bytes} [Thu Nov 11 20:31:04 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:31:07.474489 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:07.475476 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-38b4b3ab-8551-4fbf-94bd-9cd3da025ca8 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Nov 11 20:31:07.475871 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:31:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:31:07.541440 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-55743ed9-00ed-4c86-8a98-1fc52bbeb786 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "disk": 1}} {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:07.561386 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:31:07.561386 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: warnings.warn(msg) Nov 11 20:31:07.593266 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-55743ed9-00ed-4c86-8a98-1fc52bbeb786 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110348 Nov 11 20:31:07.594157 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Nov 11 20:31:07 2021] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:31:07.986180 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-83734c8f-42b0-4512-bc9a-6a06ca74d134 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:07.989662 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:31:07.989662 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: warnings.warn(msg) Nov 11 20:31:08.039435 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-83734c8f-42b0-4512-bc9a-6a06ca74d134 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.436365 Nov 11 20:31:08.040060 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Nov 11 20:31:07 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:31:10.454789 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-55743ed9-00ed-4c86-8a98-1fc52bbeb786 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:10.455800 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-55743ed9-00ed-4c86-8a98-1fc52bbeb786 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Nov 11 20:31:10.460337 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:31:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:31:10.579014 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-98b6b3cc-6e41-4bbf-9f1e-8c2f55a2213e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "ram": 512, "name": "ds512M"}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:10.596854 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:31:10.596854 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: warnings.warn(msg) Nov 11 20:31:10.620520 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-98b6b3cc-6e41-4bbf-9f1e-8c2f55a2213e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154861 Nov 11 20:31:10.621078 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Nov 11 20:31:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:31:10.635098 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-8acc9fb8-e336-4111-9aef-fa410406cf84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:10.636778 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:31:10.636778 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: warnings.warn(msg) Nov 11 20:31:10.671398 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-8acc9fb8-e336-4111-9aef-fa410406cf84 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040681 Nov 11 20:31:10.679734 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Nov 11 20:31:10 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:31:13.064273 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-98b6b3cc-6e41-4bbf-9f1e-8c2f55a2213e admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:13.067318 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-98b6b3cc-6e41-4bbf-9f1e-8c2f55a2213e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002199 Nov 11 20:31:13.067904 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:31:13 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:31:13.147852 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-458a4952-2e9b-400e-abae-303138e19fe4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:13.170394 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-458a4952-2e9b-400e-abae-303138e19fe4 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094489 Nov 11 20:31:13.170952 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Nov 11 20:31:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:31:13.184554 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-b0623d82-a8a4-47a8-b1e5-3a33a01871de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:13.209262 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-b0623d82-a8a4-47a8-b1e5-3a33a01871de admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028804 Nov 11 20:31:13.210169 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Nov 11 20:31:13 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:31:15.690654 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-458a4952-2e9b-400e-abae-303138e19fe4 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:15.692773 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-458a4952-2e9b-400e-abae-303138e19fe4 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002537 Nov 11 20:31:15.693728 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:31:15 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:31:15.764422 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-262b6274-2b9d-472d-9c81-9057dd6a5b0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:15.782960 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-262b6274-2b9d-472d-9c81-9057dd6a5b0f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075381 Nov 11 20:31:15.783495 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Nov 11 20:31:15 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:31:15.796443 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-3c594f19-77f4-42e1-8dc2-b4710a577449 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:15.819774 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-3c594f19-77f4-42e1-8dc2-b4710a577449 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026690 Nov 11 20:31:15.820366 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Nov 11 20:31:15 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:31:18.229585 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-262b6274-2b9d-472d-9c81-9057dd6a5b0f admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:18.230576 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-262b6274-2b9d-472d-9c81-9057dd6a5b0f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Nov 11 20:31:18.230970 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:31:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:31:18.301215 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-6013eda4-c9d0-44ad-a2d1-aee6c9c8ba42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "ram": 4096, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:18.327727 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-6013eda4-c9d0-44ad-a2d1-aee6c9c8ba42 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089945 Nov 11 20:31:18.328708 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Nov 11 20:31:18 2021] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:31:18.341860 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-7b8aac54-2830-4df3-8626-9bca6424782c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:18.369822 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-7b8aac54-2830-4df3-8626-9bca6424782c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031480 Nov 11 20:31:18.370401 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Nov 11 20:31:18 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:31:20.885534 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-6013eda4-c9d0-44ad-a2d1-aee6c9c8ba42 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:20.886527 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-6013eda4-c9d0-44ad-a2d1-aee6c9c8ba42 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Nov 11 20:31:20.886927 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:31:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:31:20.950334 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-d6253fd7-4871-4cec-96ea-5ea29db05d42 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:20.976347 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-d6253fd7-4871-4cec-96ea-5ea29db05d42 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081265 Nov 11 20:31:20.977171 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1291 bytes} [Thu Nov 11 20:31:20 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:31:23.565513 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-6013eda4-c9d0-44ad-a2d1-aee6c9c8ba42 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:23.570057 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-6013eda4-c9d0-44ad-a2d1-aee6c9c8ba42 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006932 Nov 11 20:31:23.570448 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:31:23 2021] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:31:23.647256 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-f334930a-9954-4c1d-a849-23cfb2337aa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:23.665708 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-f334930a-9954-4c1d-a849-23cfb2337aa7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.088266 Nov 11 20:31:23.666337 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Nov 11 20:31:23 2021] POST /compute/v2.1/flavors => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:31:23.678919 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-42743301-250f-476c-b6c8-618c23c0f6b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:23.703350 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-42743301-250f-476c-b6c8-618c23c0f6b5 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028226 Nov 11 20:31:23.704137 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Nov 11 20:31:23 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:31:26.039670 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-f334930a-9954-4c1d-a849-23cfb2337aa7 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:26.040931 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-f334930a-9954-4c1d-a849-23cfb2337aa7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 Nov 11 20:31:26.041344 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:31:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:31:26.111222 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-3c9920f6-f0a9-4ecf-80d1-e1f1aaecfd1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:26.131935 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-3c9920f6-f0a9-4ecf-80d1-e1f1aaecfd1b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083590 Nov 11 20:31:26.132646 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Nov 11 20:31:26 2021] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:31:26.146622 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-f10c800d-858d-47d3-8f19-e2c1e5b9ea06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:26.172589 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-f10c800d-858d-47d3-8f19-e2c1e5b9ea06 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030544 Nov 11 20:31:26.173561 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Nov 11 20:31:26 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:31:28.512100 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-3c9920f6-f0a9-4ecf-80d1-e1f1aaecfd1b admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:28.513214 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-3c9920f6-f0a9-4ecf-80d1-e1f1aaecfd1b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Nov 11 20:31:28.513712 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:31:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:31:28.573129 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-4cb60367-fea9-4ebb-b1eb-806586f54d8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:28.592767 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-4cb60367-fea9-4ebb-b1eb-806586f54d8b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071234 Nov 11 20:31:28.593556 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Nov 11 20:31:28 2021] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:31:28.607417 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-371ed913-70a0-43dd-a570-9170217bc8e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:28.636229 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-371ed913-70a0-43dd-a570-9170217bc8e1 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032516 Nov 11 20:31:28.636799 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Nov 11 20:31:28 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:31:31.057266 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-4cb60367-fea9-4ebb-b1eb-806586f54d8b admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:31.058396 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-4cb60367-fea9-4ebb-b1eb-806586f54d8b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Nov 11 20:31:31.058872 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:31:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:31:31.125238 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-e3ac517b-ef10-483c-8ffe-fee56b45f30b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "swap": 0}} {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:31.145136 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-e3ac517b-ef10-483c-8ffe-fee56b45f30b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079622 Nov 11 20:31:31.145693 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Nov 11 20:31:31 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:31:31.158435 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-38db57a1-4620-4591-a8b7-6630aa3c3d29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:31.183834 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-38db57a1-4620-4591-a8b7-6630aa3c3d29 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029577 Nov 11 20:31:31.184585 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Nov 11 20:31:31 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:31:33.558981 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-e3ac517b-ef10-483c-8ffe-fee56b45f30b admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:31:33.560003 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-e3ac517b-ef10-483c-8ffe-fee56b45f30b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 11 20:31:33.560416 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:31:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:31:33.626946 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-4d514c1e-77bb-409c-8456-47d963477e5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "vcpus": 8}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:33.647549 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-4d514c1e-77bb-409c-8456-47d963477e5d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080198 Nov 11 20:31:33.652203 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Nov 11 20:31:33 2021] POST /compute/v2.1/flavors => generated 408 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:31:33.660749 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-0f0effde-51b7-4fc7-bb5b-698fec29b032 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:31:33.683682 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-0f0effde-51b7-4fc7-bb5b-698fec29b032 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026843 Nov 11 20:31:33.692017 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Nov 11 20:31:33 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:32:13.906079 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-4d514c1e-77bb-409c-8456-47d963477e5d admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:13.907202 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-4d514c1e-77bb-409c-8456-47d963477e5d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Nov 11 20:32:13.907462 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:32:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:32:13.975463 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-ca5b556b-f13a-4e35-90c5-307f5b2386cd admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:13.992667 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-ca5b556b-f13a-4e35-90c5-307f5b2386cd admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076625 Nov 11 20:32:13.993209 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1291 bytes} [Thu Nov 11 20:32:13 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:32:15.538938 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-4d514c1e-77bb-409c-8456-47d963477e5d admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:15.539931 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-4d514c1e-77bb-409c-8456-47d963477e5d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Nov 11 20:32:15.540344 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Nov 11 20:32:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:32:15.729245 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-1833052a-91b4-4651-9a64-935648c83901 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:15.734672 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.wsgi [None req-1833052a-91b4-4651-9a64-935648c83901 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 11 20:32:15.735232 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-1833052a-91b4-4651-9a64-935648c83901 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:32:15.736042 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-1833052a-91b4-4651-9a64-935648c83901 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058747 Nov 11 20:32:15.736539 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Nov 11 20:32:15 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 11 20:32:15.746795 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-1caa39cf-71a5-4b17-995c-61125d8ddac6 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:15.767746 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-1caa39cf-71a5-4b17-995c-61125d8ddac6 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024509 Nov 11 20:32:15.768322 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Nov 11 20:32:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:32:15.778558 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-1b1bcf0d-2b58-48e4-bf9e-4301d30a1bb0 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:15.801649 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-1b1bcf0d-2b58-48e4-bf9e-4301d30a1bb0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026557 Nov 11 20:32:15.802197 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Nov 11 20:32:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:32:15.812661 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-d51c66d1-1afc-43f5-a97a-e5b95c309ebb admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:15.818335 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.wsgi [None req-d51c66d1-1afc-43f5-a97a-e5b95c309ebb admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 11 20:32:15.818905 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-d51c66d1-1afc-43f5-a97a-e5b95c309ebb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:32:15.819692 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-d51c66d1-1afc-43f5-a97a-e5b95c309ebb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011005 Nov 11 20:32:15.820214 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Nov 11 20:32:15 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 11 20:32:17.243344 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-1b1bcf0d-2b58-48e4-bf9e-4301d30a1bb0 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:17.244396 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-1b1bcf0d-2b58-48e4-bf9e-4301d30a1bb0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 11 20:32:17.244817 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Nov 11 20:32:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:32:17.434455 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-35e2081d-36ac-47cf-acda-8e7b0f3b7adf admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:17.442368 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.wsgi [None req-35e2081d-36ac-47cf-acda-8e7b0f3b7adf admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 11 20:32:17.442945 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-35e2081d-36ac-47cf-acda-8e7b0f3b7adf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:32:17.443736 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-35e2081d-36ac-47cf-acda-8e7b0f3b7adf admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060118 Nov 11 20:32:17.444271 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Nov 11 20:32:17 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 11 20:32:17.454206 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-d82bf8a9-a936-43e7-bd26-dfda2f9264d7 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:17.467576 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-d82bf8a9-a936-43e7-bd26-dfda2f9264d7 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016911 Nov 11 20:32:17.468128 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Nov 11 20:32:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:32:17.478669 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-8c899710-e877-4d3f-8ab2-23a12cb10bc9 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:17.493070 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-8c899710-e877-4d3f-8ab2-23a12cb10bc9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017764 Nov 11 20:32:17.493603 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Nov 11 20:32:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:32:17.503652 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-aefd516e-8a45-491d-9a5f-d5ace2b26ae3 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:17.508840 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.wsgi [None req-aefd516e-8a45-491d-9a5f-d5ace2b26ae3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 11 20:32:17.509437 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-aefd516e-8a45-491d-9a5f-d5ace2b26ae3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:32:17.510222 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-aefd516e-8a45-491d-9a5f-d5ace2b26ae3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010339 Nov 11 20:32:17.510708 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Nov 11 20:32:17 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 11 20:32:18.921536 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-8c899710-e877-4d3f-8ab2-23a12cb10bc9 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:18.922564 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-8c899710-e877-4d3f-8ab2-23a12cb10bc9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Nov 11 20:32:18.922977 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Nov 11 20:32:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:32:19.112495 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-1546531b-df3c-449f-8783-58730a6eb05c admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:19.117713 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.wsgi [None req-1546531b-df3c-449f-8783-58730a6eb05c admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 11 20:32:19.118295 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-1546531b-df3c-449f-8783-58730a6eb05c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:32:19.119125 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-1546531b-df3c-449f-8783-58730a6eb05c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058682 Nov 11 20:32:19.119617 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Nov 11 20:32:19 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 11 20:32:19.130264 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-522f37d5-3e7f-4a0a-b570-ff8bec17da92 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:19.143867 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-522f37d5-3e7f-4a0a-b570-ff8bec17da92 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017512 Nov 11 20:32:19.144417 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Nov 11 20:32:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:32:19.154895 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:19.168059 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016990 Nov 11 20:32:19.168621 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Nov 11 20:32:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:32:19.179086 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-eaee845f-5df0-430f-a8f0-bcbd13695c51 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:19.184293 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.wsgi [None req-eaee845f-5df0-430f-a8f0-bcbd13695c51 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 11 20:32:19.184848 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-eaee845f-5df0-430f-a8f0-bcbd13695c51 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:32:19.185645 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-eaee845f-5df0-430f-a8f0-bcbd13695c51 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010154 Nov 11 20:32:19.186127 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Nov 11 20:32:19 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 11 20:32:20.622914 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:20.623917 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Nov 11 20:32:20.624349 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Nov 11 20:32:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:32:20.816464 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-d09cab71-46ed-4e99-bd3e-abc62299f401 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:32:20.836041 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-d09cab71-46ed-4e99-bd3e-abc62299f401 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072180 Nov 11 20:32:20.836582 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Nov 11 20:32:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:32:22.448818 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:22.449808 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Nov 11 20:32:22.450203 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Nov 11 20:32:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:32:22.695531 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-a859a5c1-8508-40e1-b4c2-4dc345eb047b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:32:22.713359 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-a859a5c1-8508-40e1-b4c2-4dc345eb047b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.072761 Nov 11 20:32:22.713891 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Nov 11 20:32:22 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:32:24.131603 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:24.132648 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Nov 11 20:32:24.133035 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Nov 11 20:32:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:32:24.324173 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-6f491cd8-4d7d-47b5-8322-b787ad381e58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:32:24.344549 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-6f491cd8-4d7d-47b5-8322-b787ad381e58 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070514 Nov 11 20:32:24.345084 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Nov 11 20:32:24 2021] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:32:25.763644 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:25.764669 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 11 20:32:25.765062 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Nov 11 20:32:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:32:25.962360 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-f83f6273-a90c-4796-8b29-6e6fb993de08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:32:25.983263 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-f83f6273-a90c-4796-8b29-6e6fb993de08 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.073126 Nov 11 20:32:25.983730 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Nov 11 20:32:25 2021] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:32:27.396879 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:27.397870 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 11 20:32:27.398288 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Nov 11 20:32:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:32:27.590479 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-4335d1ea-42fd-49fb-9b26-330d3a9fd518 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:32:27.609875 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-4335d1ea-42fd-49fb-9b26-330d3a9fd518 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071537 Nov 11 20:32:27.610335 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Thu Nov 11 20:32:27 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:33:14.348293 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:33:14.349287 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-e89a4e8c-3742-4971-b72e-516385facc12 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Nov 11 20:33:14.349705 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 930 bytes} [Thu Nov 11 20:33:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:33:14.409020 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-425aaa7f-c69f-4cf8-8f9a-14cfe3201283 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:33:14.428012 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-425aaa7f-c69f-4cf8-8f9a-14cfe3201283 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070496 Nov 11 20:33:14.428530 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1291 bytes} [Thu Nov 11 20:33:14 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:33:14.450861 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-1e71597b-5aa8-429f-b4b3-fa19f12a702f admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:33:14.459009 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-1e71597b-5aa8-429f-b4b3-fa19f12a702f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011826 Nov 11 20:33:14.459522 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1282 bytes} [Thu Nov 11 20:33:14 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:33:14.472274 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-22ad9774-f011-4005-bbda-e76cce261c9c admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:33:14.480126 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-22ad9774-f011-4005-bbda-e76cce261c9c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012333 Nov 11 20:33:14.480671 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1285 bytes} [Thu Nov 11 20:33:14 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:33:14.493125 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-2933cb8e-23a0-453b-b38d-0cc557500358 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:33:14.502237 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-2933cb8e-23a0-453b-b38d-0cc557500358 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012715 Nov 11 20:33:14.502764 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1285 bytes} [Thu Nov 11 20:33:14 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:33:14.514477 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-3e8cc5b7-1e75-4939-a507-e818265f8aa6 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:33:14.522717 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-3e8cc5b7-1e75-4939-a507-e818265f8aa6 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011725 Nov 11 20:33:14.523225 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1282 bytes} [Thu Nov 11 20:33:14 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:34:37.764906 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-bb625a2a-3234-4af5-9dd9-a0f29932de25 tempest-verify_tempest_config-99321609 tempest-verify_tempest_config-99321609-project] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:34:37.766856 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-bb625a2a-3234-4af5-9dd9-a0f29932de25 tempest-verify_tempest_config-99321609 tempest-verify_tempest_config-99321609-project] 10.222.0.61 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106048 Nov 11 20:34:37.767386 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 34/69] 10.222.0.61 () {58 vars in 1133 bytes} [Thu Nov 11 20:34:37 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:36:11.266095 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-3e8cc5b7-1e75-4939-a507-e818265f8aa6 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:36:11.267099 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-3e8cc5b7-1e75-4939-a507-e818265f8aa6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Nov 11 20:36:11.267488 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 36/70] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Nov 11 20:36:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:36:11.519880 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-788ac1aa-4b4f-47fc-bebb-f2814f8646d6 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:36:11.521087 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:36:11.521087 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: warnings.warn(msg) Nov 11 20:36:11.522708 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-788ac1aa-4b4f-47fc-bebb-f2814f8646d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:36:11.523150 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-788ac1aa-4b4f-47fc-bebb-f2814f8646d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:36:11.523941 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-788ac1aa-4b4f-47fc-bebb-f2814f8646d6 admin admin] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:36:11.524396 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-788ac1aa-4b4f-47fc-bebb-f2814f8646d6 admin admin] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:36:11.556808 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-788ac1aa-4b4f-47fc-bebb-f2814f8646d6 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148146 Nov 11 20:36:11.557362 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 35/71] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Nov 11 20:36:11 2021] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:36:13.003126 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-3e8cc5b7-1e75-4939-a507-e818265f8aa6 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:36:13.004570 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-3e8cc5b7-1e75-4939-a507-e818265f8aa6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 Nov 11 20:36:13.004966 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 37/72] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Nov 11 20:36:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:36:13.200794 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-7d331bca-6656-4df5-84c7-6c3833cc1924 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:36:13.202023 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:36:13.202023 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: warnings.warn(msg) Nov 11 20:36:13.203637 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-7d331bca-6656-4df5-84c7-6c3833cc1924 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:36:13.204156 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-7d331bca-6656-4df5-84c7-6c3833cc1924 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:36:13.204951 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-7d331bca-6656-4df5-84c7-6c3833cc1924 admin admin] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:36:13.205372 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-7d331bca-6656-4df5-84c7-6c3833cc1924 admin admin] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:36:13.224745 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-7d331bca-6656-4df5-84c7-6c3833cc1924 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078925 Nov 11 20:36:13.225226 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 36/73] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Nov 11 20:36:13 2021] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:36:25.113281 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-3e8cc5b7-1e75-4939-a507-e818265f8aa6 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:36:25.114297 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-3e8cc5b7-1e75-4939-a507-e818265f8aa6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Nov 11 20:36:25.114687 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 38/74] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Nov 11 20:36:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:36:25.305726 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-d582267b-99bd-413e-b2a8-59981bc511f5 admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:36:25.306882 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:36:25.306882 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: warnings.warn(msg) Nov 11 20:36:25.309041 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-d582267b-99bd-413e-b2a8-59981bc511f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:36:25.309481 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-d582267b-99bd-413e-b2a8-59981bc511f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:36:25.310270 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-d582267b-99bd-413e-b2a8-59981bc511f5 admin admin] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:36:25.310697 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-d582267b-99bd-413e-b2a8-59981bc511f5 admin admin] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:36:25.334548 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-d582267b-99bd-413e-b2a8-59981bc511f5 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079109 Nov 11 20:36:25.335097 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 37/75] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Nov 11 20:36:25 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:36:26.801827 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: DEBUG nova.api.openstack.wsgi [None req-3e8cc5b7-1e75-4939-a507-e818265f8aa6 admin admin] Calling method '>' {{(pid=101108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:36:26.802850 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: INFO nova.api.openstack.requestlog [None req-3e8cc5b7-1e75-4939-a507-e818265f8aa6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Nov 11 20:36:26.803235 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: [pid: 101108|app: 0|req: 39/76] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Nov 11 20:36:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:36:26.998482 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG nova.api.openstack.wsgi [None req-29590005-6c53-4453-92b7-e8497baeacdc admin admin] Calling method '>' {{(pid=101109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:36:26.999635 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:36:26.999635 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: warnings.warn(msg) Nov 11 20:36:27.001181 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-29590005-6c53-4453-92b7-e8497baeacdc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:36:27.001619 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-29590005-6c53-4453-92b7-e8497baeacdc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:36:27.002398 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-29590005-6c53-4453-92b7-e8497baeacdc admin admin] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:36:27.002818 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: DEBUG oslo_concurrency.lockutils [None req-29590005-6c53-4453-92b7-e8497baeacdc admin admin] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:36:27.023895 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: INFO nova.api.openstack.requestlog [None req-29590005-6c53-4453-92b7-e8497baeacdc admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080264 Nov 11 20:36:27.024491 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: [pid: 101109|app: 0|req: 38/77] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Nov 11 20:36:26 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:37:31.518113 dv-cinder-817642-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 11 20:37:31.518641 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: Thu Nov 11 20:37:31 2021 - graceful shutdown triggered... Nov 11 20:37:31.519618 dv-cinder-817642-1-iscsi devstack@n-api.service[101108]: Gracefully killing worker 1 (pid: 101108)... Nov 11 20:37:31.521950 dv-cinder-817642-1-iscsi devstack@n-api.service[101109]: Gracefully killing worker 2 (pid: 101109)... Nov 11 20:37:32.519595 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: worker 1 buried after 1 seconds Nov 11 20:37:32.520020 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: worker 2 buried after 1 seconds Nov 11 20:37:32.520020 dv-cinder-817642-1-iscsi devstack@n-api.service[101107]: goodbye to uWSGI. Nov 11 20:37:32.521232 dv-cinder-817642-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 11 20:37:32.521788 dv-cinder-817642-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 11 20:37:32.524616 dv-cinder-817642-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 11 20:37:32.535282 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 11 20:37:32.537661 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Nov 11 20:37:32 2021] *** Nov 11 20:37:32.537661 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 11 20:37:32.537661 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 11 20:37:32.537661 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: nodename: dv-cinder-817642-1-iscsi Nov 11 20:37:32.537661 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: machine: x86_64 Nov 11 20:37:32.537661 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: clock source: unix Nov 11 20:37:32.537661 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: pcre jit disabled Nov 11 20:37:32.537661 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: detected number of CPU cores: 4 Nov 11 20:37:32.537661 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: current working directory: / Nov 11 20:37:32.537661 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: detected binary path: /usr/bin/uwsgi-core Nov 11 20:37:32.538439 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: your processes number limit is 47680 Nov 11 20:37:32.538439 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: your memory page size is 4096 bytes Nov 11 20:37:32.538439 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: detected max file descriptor number: 2048 Nov 11 20:37:32.538439 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: lock engine: pthread robust mutexes Nov 11 20:37:32.538439 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: thunder lock: enabled Nov 11 20:37:32.538439 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 11 20:37:32.538439 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 11 20:37:32.589293 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: Python main interpreter initialized at 0x564c066fa9c0 Nov 11 20:37:32.589293 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: python threads support enabled Nov 11 20:37:32.589293 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: your server socket listen backlog is limited to 100 connections Nov 11 20:37:32.589293 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: your mercy for graceful operations on workers is 90 seconds Nov 11 20:37:32.589727 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: mapped 403077 bytes (393 KB) for 2 cores Nov 11 20:37:32.589727 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: *** Operational MODE: preforking *** Nov 11 20:37:32.590046 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: *** uWSGI is running in multiple interpreter mode *** Nov 11 20:37:32.590207 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: spawned uWSGI master process (pid: 122505) Nov 11 20:37:32.590528 dv-cinder-817642-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 11 20:37:32.592775 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: spawned uWSGI worker 1 (pid: 122526, cores: 1) Nov 11 20:37:32.601910 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: spawned uWSGI worker 2 (pid: 122527, cores: 1) Nov 11 20:37:32.601910 dv-cinder-817642-1-iscsi devstack@n-api.service[122505]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 11 20:37:34.460405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 20:37:34.460405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: from cryptography.utils import int_from_bytes Nov 11 20:37:34.461086 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 20:37:34.461086 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: from cryptography.utils import int_from_bytes Nov 11 20:37:34.468899 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 20:37:34.468899 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: from cryptography.utils import int_from_bytes Nov 11 20:37:34.469420 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 11 20:37:34.469420 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: from cryptography.utils import int_from_bytes Nov 11 20:37:36.812720 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 20:37:36.813558 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 20:37:36.814058 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 20:37:36.814430 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 20:37:36.814694 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 20:37:36.815088 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.815420 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.815788 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.816149 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.816458 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.816774 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.817094 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.817418 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.817752 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.818014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.818331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.818687 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817642-1-iscsi {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.819014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.819325 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.819641 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.819965 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.820344 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.820626 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.820951 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.821707 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.822918 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.822918 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.823120 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.823392 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.823721 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.824056 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.824385 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.824695 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.825028 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.825341 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.825748 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817642-1-iscsi {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.826073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.826394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.826712 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.827136 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.827452 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.827767 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.828119 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.828451 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.828764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.829097 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.829426 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.829750 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.830075 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.830383 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.830692 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.831004 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.831850 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.832188 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.832497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.832751 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.833065 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.833388 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.833717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.834043 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.834299 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.834554 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.834881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.835208 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.835525 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.835838 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.836173 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.836485 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.836801 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.837115 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.837431 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.837743 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.838079 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.838389 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.838716 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.839030 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.839354 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.839762 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.840280 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.840383 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.840689 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.841015 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.841326 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.841652 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.841980 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.842290 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.842600 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.842914 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.843281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.843628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.843939 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.844224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.844529 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.844838 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.845528 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.845528 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.845780 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.846071 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.846376 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.846688 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.847645 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.847966 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.848304 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.848615 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.848928 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.849242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.849552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.849864 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.850194 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.850523 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.850835 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.851148 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.851459 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.851774 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.852122 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.852439 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.852749 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.853078 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.853387 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.853696 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.854022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.854334 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.854646 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.854970 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.855275 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.855588 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.855910 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.856249 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.856555 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.856865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.857178 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.857508 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.857793 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.858261 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.858724 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.859211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.859703 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.860756 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.861130 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.861415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.861733 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.862058 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.862408 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.862797 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.863152 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.863480 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.863814 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.864178 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.864507 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.864820 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.865146 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.865479 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.865797 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.866114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.866432 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.866756 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.867084 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.867422 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.867748 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.867996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 11 20:37:36.868430 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.868504 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 11 20:37:36.868605 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.868712 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.868806 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 11 20:37:36.869024 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.869152 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 11 20:37:36.869383 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 11 20:37:36.869627 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.869795 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.869956 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.870104 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.870437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.870539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.870755 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.870859 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.871090 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.871251 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.871401 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.871555 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.871721 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.871877 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.872071 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.872227 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.872385 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.872568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.872719 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.872859 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.873000 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.873171 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.873313 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-817642-1-iscsi {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.873466 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.873608 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.873746 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.873913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.874066 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.874218 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.874372 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.874529 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.874672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.874811 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.874958 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.875627 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.875798 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.875942 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.876118 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.876118 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.876415 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.876589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.876744 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.876885 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.877026 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.877166 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.877336 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.877485 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.877635 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.877782 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.877929 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.878108 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.878272 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.878431 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.878576 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.878732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.878732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.879014 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.879236 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.880612 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.880779 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.880932 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.881075 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.881075 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.881362 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-817642-1-iscsi {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.881506 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.881654 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.881874 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.882033 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.882189 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.882331 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.882478 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.882621 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.882761 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.882916 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.883101 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.883250 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.883397 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.883545 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.883687 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.883847 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.884015 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.884177 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.884328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.884328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.884650 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.884806 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.884956 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.885105 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.885246 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.885246 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.886043 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.886198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.886346 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.886497 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.886637 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.886788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.886938 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.887079 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.887227 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.887375 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.887527 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.887676 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.887831 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.888017 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.888187 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.888335 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.888481 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.888621 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.888770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.888913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.889060 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.889210 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.889368 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.889714 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.889864 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.890006 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.890158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.890421 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.890576 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.890727 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.890869 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.891601 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.891754 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.891897 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.892643 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.892807 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.892950 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.893094 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.893234 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.893394 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.893545 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.894563 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.894732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.894883 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.895032 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.895183 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.895333 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.895497 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.896203 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.896369 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.896520 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.896674 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.896823 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.896974 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.897248 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.897423 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.897628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.897807 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.897965 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.898120 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.898261 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.898403 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.898543 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.898543 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.898820 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.898975 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.899118 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.899278 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.899421 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.899570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.899905 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.900074 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.900317 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.900589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.900739 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.900887 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.901042 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.901197 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.901339 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.901480 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.901628 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.901776 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.901931 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.902080 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.902221 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.902361 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.902503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.902503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.902785 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.902933 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.903091 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.903240 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.903386 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.903528 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.903682 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.903824 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.903963 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.904140 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.904282 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.904434 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.904584 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.904734 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.904885 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.905033 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.905181 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.905336 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.905478 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.905619 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.905775 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.906341 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.906501 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.906738 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.906891 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.907033 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.907173 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.907325 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.907480 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.907623 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.907763 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.907911 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.908144 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.908300 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.908450 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.908599 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.908746 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.908896 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.909037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.909184 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.909415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.909627 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.909832 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.911038 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.911256 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.911462 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.911670 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.911868 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.912104 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.912304 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.912532 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.912726 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.912918 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.913126 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.913320 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.913590 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.913791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.913993 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.914202 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.914408 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.914628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.914840 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.915041 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.915274 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.915420 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.915568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.915735 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.915885 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.916047 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.916646 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.917350 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.917516 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.917516 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.917799 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.917799 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.918072 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.918221 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.918372 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.918372 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.918668 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.918809 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.918955 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.919103 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.919263 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.919406 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.919546 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.919685 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.919831 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.919999 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.920160 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.920312 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.920472 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.920614 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.921024 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.921178 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.921329 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.921329 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.921612 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 11 20:37:36.921762 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.921913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.922068 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.922219 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.922387 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.922709 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.922878 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.923030 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.923181 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.923323 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.923475 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.923624 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.923773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.923915 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.924133 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.924277 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.924425 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.924568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.924720 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.924875 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.924875 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.925825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.925988 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.926146 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.926324 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.927373 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.927540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.927701 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.927852 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.928032 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.928196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.928366 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.928516 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.928664 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.928827 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.928977 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.929131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.929294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.929450 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.929606 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.929773 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.929931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.930088 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.930238 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.930398 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.930553 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.930709 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.930865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.931277 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.931277 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.931575 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.931724 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.931874 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.932039 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.932204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.932361 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.932516 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.932683 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.932970 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.933134 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.933297 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.933447 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.933596 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.934275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.934446 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.934606 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.934755 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.934903 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.934903 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.935205 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.935205 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.935496 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.935645 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.935793 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.935793 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.936111 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.936273 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.936435 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.936738 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.937092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.937266 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.937509 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.937677 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.937840 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.937996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.938154 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.938303 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.938450 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.938612 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.938768 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.938916 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.939065 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.939220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.939369 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.939527 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.939708 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.939859 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.940026 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.940265 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.940426 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.940599 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.941501 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.941664 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.941898 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.942116 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.942333 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.942552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.942767 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.943013 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.943339 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.943567 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.943748 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.944532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.944696 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.944859 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.945023 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.945187 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.945344 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.945494 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.945642 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.945809 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.945975 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.946387 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.946539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.946707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.947197 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.947376 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.947552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.947808 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.948042 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.948210 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.948359 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.948556 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.948724 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.948724 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.949019 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.949174 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.949329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.949488 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.949653 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.949653 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.949935 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.950082 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.950227 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.950387 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.950536 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.950693 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.950850 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.951006 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.951168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.951317 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.951734 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.951899 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.952081 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.952239 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.952398 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.952585 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.952770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.952921 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.953086 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.953244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.953508 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.953674 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.953831 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.953982 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.954128 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.954275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.954430 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.954586 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.954735 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.954882 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.955049 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.955207 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.955355 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.955510 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.955664 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.955812 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.955959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.956144 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.956323 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.956480 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.956628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.956775 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.956949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.957392 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.957549 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.957697 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.957950 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.958114 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.958263 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.958432 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.958581 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.958727 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.958881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.959030 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.959187 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.959337 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.959503 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.959503 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.959805 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.959952 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.960191 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.960352 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.960512 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.960663 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.960812 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.960959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.961114 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.961264 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.961420 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.961603 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.962006 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.962163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.962322 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.962471 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.962619 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.962766 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.962914 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.963069 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.963226 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.963375 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.963609 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.963763 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.963922 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.964110 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.964268 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.964425 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.964574 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.964722 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.964877 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.965034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.965183 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.965345 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.965503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.965503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.965803 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.966061 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.966217 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.966372 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.966521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.966669 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.966816 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.966971 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.967120 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.967580 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.967745 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.967902 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.968211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.968378 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.968534 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.968691 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.968848 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.969005 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.969162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.969310 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.969473 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.969633 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.970690 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.970855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.971012 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.971187 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.971337 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.971498 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.971498 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.972594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.972594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.972890 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.973046 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.973205 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.973360 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.973518 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.973763 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.973926 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.974093 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.974251 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.974409 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.974565 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.974712 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.974861 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.975008 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.975244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.975244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.975244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.975244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.975244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.975244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.975244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.975244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.976437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.976437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.976437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.976437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.976437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.976437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.976437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.976437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.977915 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.977915 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.977915 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.977915 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.978634 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.978791 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.978940 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.979103 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.979252 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.979408 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.979556 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.979703 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.979851 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.980105 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.980261 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.980427 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.980583 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.980732 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.980890 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.981047 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.981196 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.981354 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.981502 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.981657 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.982069 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.982222 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.982370 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.982536 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.982906 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.983058 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.983388 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.983547 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.983719 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.984026 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.984122 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.984193 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.984193 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.984364 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.984446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.984534 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.984616 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.984711 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.984801 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.984891 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.984973 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.985065 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.985153 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.985153 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.985319 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.985319 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.985474 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.985474 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.985639 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.985733 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.985824 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.985905 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.985986 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.986072 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.986167 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.986257 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.986340 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.986420 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.986499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.986499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.986661 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.986821 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.986908 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.986990 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.987073 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.987073 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.987242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.987334 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.987417 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.988448 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.988615 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.988716 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.988811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.988895 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.988984 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.989074 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.989156 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.989237 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.989343 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.989436 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.989594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.989693 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.989778 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.989871 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.989954 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.990035 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.990122 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.990212 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.990301 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.990396 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.990486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.990569 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.990657 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.990757 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.990829 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.990897 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.990973 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.991044 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.991124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.991195 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.991274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.991354 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.991440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.991523 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.991612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.991701 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.991791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.991873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.991954 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.992121 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.992121 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.992379 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.992506 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.992733 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.993440 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.993575 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.993756 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.993906 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.994104 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.994230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.994342 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.994466 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.994577 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.994693 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.994804 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.994912 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.995021 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.995138 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.995269 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.995387 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.995496 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.995612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.995740 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.995859 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.995988 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.996115 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.996236 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.996357 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.996480 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.996591 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.996706 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.996840 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.996974 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.997110 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.997248 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.997378 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.997580 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.997711 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.997839 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.997976 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.998113 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.998243 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.998601 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.998733 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.998873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.999004 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.999210 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.999349 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:36.999479 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.000201 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.000289 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.000391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.000482 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.000565 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.000652 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.000733 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.000827 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.000918 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.001000 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.001000 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.001163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.001244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.001342 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.001425 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.001513 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.001595 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.001675 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.001755 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.001910 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.002003 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.002093 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.002229 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.002324 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.002414 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.002506 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.002595 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.002684 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.002766 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.002847 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.002939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.003023 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.003139 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.003225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.003307 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.003477 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.003581 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.003581 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.003740 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.003818 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.003895 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.003986 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.004095 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.004183 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.004265 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.004346 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.004435 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.004518 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.004612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.004695 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.004779 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.004856 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.005021 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.005121 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.005204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.005292 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.005380 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.005462 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.005543 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.005632 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.005713 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.005800 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.005888 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.005969 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.006050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.006142 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.006235 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.006323 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.006413 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.006502 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.006583 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.006583 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.006729 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.006799 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.006874 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.006943 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.007023 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.007093 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.007168 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.007238 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.007305 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.007305 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.007305 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.007497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.007497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.007497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.007927 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.008076 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.008168 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.008247 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.008318 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.008386 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.008471 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.008764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.008848 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.008920 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.008996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.009065 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.009139 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.009139 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.009279 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.009347 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.009414 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.009673 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.009767 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.009937 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.010031 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.010255 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.010342 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.010573 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.010653 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.010892 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.010974 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.011239 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.011341 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.011520 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.011612 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.012129 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.012226 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.012296 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.012365 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.012485 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.012718 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.012884 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.013010 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.013102 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.013336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.013441 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.013714 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.013818 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.014029 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.014371 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.014484 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.014659 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.014746 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.014953 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.015046 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.015272 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.015417 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.015585 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.015701 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.015915 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.016034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.016261 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.016440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.016601 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.016744 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.016886 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.017041 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.017197 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.017352 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.017471 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.017656 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.017787 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.018120 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.018239 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.018454 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.018552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.018903 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.019017 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.019192 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.019383 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.019525 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.019663 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.019904 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.020096 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.020198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.020302 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.020417 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.020509 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.020729 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.020828 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.021108 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.021207 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.021416 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.021515 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.021731 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.021830 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.022067 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.022166 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.022380 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.022675 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.022773 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.022995 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.023097 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.023307 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.023396 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.023623 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.023711 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.023934 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.024055 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.024282 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.024407 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.024604 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.024726 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.024917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.025042 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.025245 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.025343 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.025671 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.025762 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.025987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.026086 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.026299 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.026397 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.026616 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.026704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.026959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.027051 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.027279 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.027379 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.027639 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.027797 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.028042 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.028199 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.028329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.028462 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.028640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.028793 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.028966 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.029120 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.029285 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.029429 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.029597 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.029750 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.029914 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.030058 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.030230 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.030353 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.030550 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.030654 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.030862 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.030961 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.031194 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.031286 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.031525 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.031623 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.031843 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.031934 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.032198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.032552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.032644 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.032951 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.033067 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.033187 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.033277 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.033498 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.033588 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.033876 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.034077 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.034237 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.034905 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.035053 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.035203 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.035349 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.035535 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.035688 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.035866 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.036044 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.036224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.036324 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.036540 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.036631 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.036857 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.036957 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.037173 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.037389 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.037480 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.037787 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.037877 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.038099 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.038300 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.038432 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.038623 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.038746 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.038941 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.039066 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.039255 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.039478 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.039725 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.039839 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.040202 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.040395 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.040731 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.040841 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.041049 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.041156 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.041362 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.041460 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.041673 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.041770 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.041981 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.042085 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.042310 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.042406 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.042624 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.042723 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.042937 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.043050 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.043255 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.043349 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.043566 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.043673 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.043877 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.044073 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.044421 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.044758 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.045086 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.045256 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.045408 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.045581 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.045743 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.045910 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.046055 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.046230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.046367 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.046540 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.046685 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.046858 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.046995 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.047188 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.047339 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.047505 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.047604 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.047823 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.047921 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.048168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.048346 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.048503 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.048656 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.048817 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.048958 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.049190 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.049562 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.049663 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.049755 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.049904 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.050182 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.050335 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.050598 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.050715 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.050927 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.051075 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.051250 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.051389 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.051608 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.051741 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.051930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.052094 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.052440 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.052546 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.052768 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.052898 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.053102 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.053204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.053440 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.053545 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.054225 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.054348 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.054480 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.054572 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.054665 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.054749 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.054839 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.054928 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.055017 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.055142 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.055329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.055423 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.055651 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.055743 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.056002 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.056109 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.056307 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.056399 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.056619 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.056712 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.056932 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.057023 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.057248 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.057340 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.057559 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.057651 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.057871 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.058137 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.058236 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.058477 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.058575 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.058804 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.058904 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.059126 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.059240 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.059445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.059579 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.059756 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.059858 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.060089 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.060198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.060403 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.060557 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.060713 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.060819 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.061030 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.061121 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.061350 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.061441 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.061663 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.061762 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.061969 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.062061 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.062325 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.062416 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.062673 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.062821 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.062999 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.063092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.063318 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.063408 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.063627 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.063721 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.063949 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.064103 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.064297 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.064432 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.064611 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.064706 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.064933 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.065025 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.065245 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.065336 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.066070 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.066177 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.066421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.066595 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.066752 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.067003 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.067095 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.067327 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.067419 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.067651 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.067743 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.068071 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.068181 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.068311 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.068402 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.068635 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.068735 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.068953 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.069051 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.069297 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.069406 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.069584 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.069743 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.069908 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.070060 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.070204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.070347 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.070527 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.070696 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.070845 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.070985 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.071415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.071552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.071732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.071993 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.072165 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.072328 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.072468 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.072640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.072783 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.072972 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.073123 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.073283 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.073431 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.073595 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.073747 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.073906 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.074047 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.074234 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.074384 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.074532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.074629 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.074845 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.074990 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.075162 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.075255 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.075480 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.075621 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.075793 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.076148 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.076468 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.076744 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.076917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.077068 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.077224 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.077382 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.077544 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.077705 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.077916 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.078075 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.078271 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.078435 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.078592 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.078752 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.078912 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.079062 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.079240 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.079525 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.079770 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.080037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.080209 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.080368 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.080530 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.080832 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.080988 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.081265 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.081918 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.082074 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.082393 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.082519 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.082788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.082901 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.083117 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.083394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.083487 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.083793 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.083952 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.084125 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.084217 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.084421 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.084550 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.084689 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 20:37:37.084822 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.085050 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.085366 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.085705 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.086024 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.086339 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.086656 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.086977 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.087290 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.087605 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.087924 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.088260 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.088592 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.088909 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.089230 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.089541 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.089867 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.090206 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.090545 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.090858 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.091196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.091511 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.091825 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.092178 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.092518 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.092827 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.093151 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.093470 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.093949 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.094164 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.094690 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.095089 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.095425 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.095793 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.096156 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.096476 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.096792 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.097170 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.097534 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.098031 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.098356 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.098681 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.098999 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.099318 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.099634 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.099952 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.100300 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.100618 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.100968 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.101295 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.101618 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.101940 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.102263 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.102667 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.102899 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.103215 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.103547 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.104429 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.104775 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.104875 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.105174 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.105994 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.105994 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.106234 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.106561 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.106877 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.107209 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.107543 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.107864 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.108212 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.108533 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.108648 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_db.sqlalchemy.engines [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:37:37.108864 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.109219 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.109558 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.109894 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.110262 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.111861 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.111861 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.111861 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.111861 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.111861 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.112429 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.112429 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.112748 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.113226 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.113558 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.113890 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.114218 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.114535 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.115599 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.115599 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.115599 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.115881 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.116125 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.116443 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.116760 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.117096 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.117430 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.117748 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.118076 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.118423 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.118818 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.119045 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.119363 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.119702 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.123662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.123662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.123662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.123662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.123662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.123662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.123662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.123662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.125131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.125131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.125131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.125131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.125131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.125131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.125131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.125131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.126287 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 11 20:37:37.126287 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 11 20:37:37.149429 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_db.sqlalchemy.engines [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:37:37.276181 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.context [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f28bff3-30b2-4836-a432-daa68ea6bc82(cell1) {{(pid=122526) load_cells /opt/stack/nova/nova/context.py:464}} Nov 11 20:37:37.280769 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:37:37.282438 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:37:37.283348 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:37:37.285744 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:37:37.297530 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_db.sqlalchemy.engines [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:37:37.299426 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_db.sqlalchemy.engines [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:37:37.318901 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.context [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f28bff3-30b2-4836-a432-daa68ea6bc82(cell1) {{(pid=122527) load_cells /opt/stack/nova/nova/context.py:464}} Nov 11 20:37:37.323375 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:37:37.325043 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:37:37.325882 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:37:37.328075 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:37:37.340808 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_db.sqlalchemy.engines [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:37:37.342444 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_db.sqlalchemy.engines [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:37:37.467685 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_db.sqlalchemy.engines [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:37:37.514396 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_db.sqlalchemy.engines [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 11 20:37:37.794328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: WARNING keystonemiddleware.auth_token [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 20:37:37.801685 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: WARNING keystonemiddleware.auth_token [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 20:37:37.840031 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: WARNING keystonemiddleware.auth_token [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 20:37:37.846787 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: WARNING keystonemiddleware.auth_token [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 20:37:38.027600 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: WARNING keystonemiddleware.auth_token [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 20:37:38.032807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: WARNING keystonemiddleware.auth_token [None req-e5125bdc-dd55-45f4-8f4a-9296a9c3140f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 20:37:38.038611 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564c066fa9c0 pid: 122526 (default app) Nov 11 20:37:38.076175 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: WARNING keystonemiddleware.auth_token [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 11 20:37:38.081948 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: WARNING keystonemiddleware.auth_token [None req-c1b9e17f-8b25-4eb4-af1e-c84630691882 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 11 20:37:38.087624 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564c066fa9c0 pid: 122527 (default app) Nov 11 20:38:15.826304 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1290409903", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "networks": [{"uuid": "4eaea89b-928d-40c8-a51e-812ae04a8ab3"}]}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:38:16.039676 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1098978756", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "networks": [{"uuid": "f75b74a3-4944-4e66-a1f1-0eb754745d66"}]}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:38:16.444603 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.network.neutron [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] validate_networks() for [('f75b74a3-4944-4e66-a1f1-0eb754745d66', None, None, None, None, None)] {{(pid=122527) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:38:16.509641 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.network.neutron [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] validate_networks() for [('4eaea89b-928d-40c8-a51e-812ae04a8ab3', None, None, None, None, None)] {{(pid=122526) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:38:18.798501 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Flavor limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:38:18.799817 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Image limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:38:18.800564 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Flavor pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:38:18.801700 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Image pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:38:18.802417 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:38:18.831414 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:18.832168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:18.833384 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:18.834054 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:18.899296 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Getting quotas for project 0daea5c9b8ea4f91b977e9e3cd28c055. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:38:18.922198 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Getting quotas for user b42b900060b74a14b00e53b51393dbb0 and project 0daea5c9b8ea4f91b977e9e3cd28c055. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:38:18.949733 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Going to run 1 instances... {{(pid=122526) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:38:18.959299 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:38:18.993570 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Flavor limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:38:18.994675 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Image limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:38:18.995520 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Flavor pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:38:18.996137 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Image pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:38:18.996725 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:38:19.034557 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:19.039743 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:19.040678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:19.045943 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:19.148430 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Getting quotas for project 7b92a8a05c22447985ae53c7b9c91fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:38:19.171877 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Getting quotas for user f77c253d448e482db5ecbc453e4e0f3e and project 7b92a8a05c22447985ae53c7b9c91fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:38:19.183341 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f760182a-a020-4463-90e3-cb14e71a4610 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.483506 Nov 11 20:38:19.189343 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:38:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 4500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:38:19.194712 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-79314da9-8924-4b15-8d7b-908034e54144 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:19.195331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-79314da9-8924-4b15-8d7b-908034e54144 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:19.212275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Going to run 1 instances... {{(pid=122527) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:38:19.224591 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:38:19.395461 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-79314da9-8924-4b15-8d7b-908034e54144 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:19.437406 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-79314da9-8924-4b15-8d7b-908034e54144 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1215 microversion: 2.1 time: 0.246697 Nov 11 20:38:19.446365 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 2/2] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:19 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1215 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:19.544290 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a1acf807-b82f-4f51-b8b3-87dcd30e37bf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.794840 Nov 11 20:38:19.544935 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:38:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 4797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 11 20:38:19.555876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0f16cd76-5378-4f3d-b071-6e1fe6c023c2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:19.556714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0f16cd76-5378-4f3d-b071-6e1fe6c023c2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:19.893548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0f16cd76-5378-4f3d-b071-6e1fe6c023c2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:19.903509 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0f16cd76-5378-4f3d-b071-6e1fe6c023c2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1218 microversion: 2.1 time: 0.352114 Nov 11 20:38:19.911445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 3/4] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:19 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1218 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:20.465037 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-33c23ad5-c291-429e-b304-02a12c9f12fd tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:20.465664 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-33c23ad5-c291-429e-b304-02a12c9f12fd tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:20.812396 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-33c23ad5-c291-429e-b304-02a12c9f12fd tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:20.853866 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-33c23ad5-c291-429e-b304-02a12c9f12fd tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1215 microversion: 2.1 time: 0.392704 Nov 11 20:38:20.879002 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 2/5] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:20 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1215 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:20.920496 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-19ea1ff2-0eca-4cbe-8740-8316eb4f105c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:20.921316 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-19ea1ff2-0eca-4cbe-8740-8316eb4f105c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:21.215331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-19ea1ff2-0eca-4cbe-8740-8316eb4f105c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:21.222239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-19ea1ff2-0eca-4cbe-8740-8316eb4f105c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1218 microversion: 2.1 time: 0.305295 Nov 11 20:38:21.224834 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 4/6] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:20 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1218 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:21.871428 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e5f83e3b-e81b-4f6c-9a4e-28bd292be06e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:21.872785 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e5f83e3b-e81b-4f6c-9a4e-28bd292be06e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:21.884795 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e5f83e3b-e81b-4f6c-9a4e-28bd292be06e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:21.885333 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e5f83e3b-e81b-4f6c-9a4e-28bd292be06e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:21.887441 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e5f83e3b-e81b-4f6c-9a4e-28bd292be06e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:21.888024 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e5f83e3b-e81b-4f6c-9a4e-28bd292be06e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:22.249807 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e5f83e3b-e81b-4f6c-9a4e-28bd292be06e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:22.270973 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e5f83e3b-e81b-4f6c-9a4e-28bd292be06e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1219 microversion: 2.1 time: 0.403152 Nov 11 20:38:22.271581 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 3/7] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:21 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1219 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:22.280961 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d26f5e05-6e2a-42a4-998f-e31fbf2774ee tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:22.281580 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d26f5e05-6e2a-42a4-998f-e31fbf2774ee tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:22.307556 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d26f5e05-6e2a-42a4-998f-e31fbf2774ee tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:22.308072 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d26f5e05-6e2a-42a4-998f-e31fbf2774ee tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:22.312372 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d26f5e05-6e2a-42a4-998f-e31fbf2774ee tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:22.312917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d26f5e05-6e2a-42a4-998f-e31fbf2774ee tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:22.505639 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d26f5e05-6e2a-42a4-998f-e31fbf2774ee tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:22.516826 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d26f5e05-6e2a-42a4-998f-e31fbf2774ee tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1222 microversion: 2.1 time: 0.244128 Nov 11 20:38:22.518415 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:22 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1222 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:22.589820 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1891485610", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acd422cb-07fc-4b63-aaab-fd2e52fc9069"}]}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:38:22.738200 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.network.neutron [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] validate_networks() for [('acd422cb-07fc-4b63-aaab-fd2e52fc9069', None, None, None, None, None)] {{(pid=122526) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:38:23.335694 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-671aa5d2-4501-4e96-ad6d-7ef84fcbc95c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'create', calling method: .version_select at 0x7ff3f017e5e0>, body: {"keypair": {"name": "tempest-keypair-288013805"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:38:23.407431 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-671aa5d2-4501-4e96-ad6d-7ef84fcbc95c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Getting quotas for project 38d540a76ef9405bb94b7e433494fabd. Resources: {'key_pairs'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:38:23.412150 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-671aa5d2-4501-4e96-ad6d-7ef84fcbc95c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Getting quotas for user c3e90865af2147c995fb58e24129d032 and project 38d540a76ef9405bb94b7e433494fabd. Resources: {'key_pairs'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:38:23.720940 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Flavor limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:38:23.722094 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Image limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:38:23.726618 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Flavor pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:38:23.728416 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Image pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:38:23.729087 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:38:23.776003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:23.776003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:23.776003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:23.776003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:23.811433 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-671aa5d2-4501-4e96-ad6d-7ef84fcbc95c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Getting quotas for project 38d540a76ef9405bb94b7e433494fabd. Resources: {'key_pairs'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:38:23.815609 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-671aa5d2-4501-4e96-ad6d-7ef84fcbc95c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Getting quotas for user c3e90865af2147c995fb58e24129d032 and project 38d540a76ef9405bb94b7e433494fabd. Resources: {'key_pairs'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:38:23.815733 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Getting quotas for project 8473830434694f05acc123584bf48e18. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:38:23.829822 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Getting quotas for user 87f969040e0245d9a4894bd40ed8f72f and project 8473830434694f05acc123584bf48e18. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:38:23.830325 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-671aa5d2-4501-4e96-ad6d-7ef84fcbc95c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.912827 Nov 11 20:38:23.838245 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 5/9] 10.222.0.61 () {62 vars in 1198 bytes} [Thu Nov 11 20:38:22 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 922 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 11 20:38:23.842983 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-312838ef-8d82-463f-95ac-60202dc52135 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:23.843793 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-312838ef-8d82-463f-95ac-60202dc52135 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:23.851823 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-312838ef-8d82-463f-95ac-60202dc52135 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:23.852305 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-312838ef-8d82-463f-95ac-60202dc52135 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:23.853096 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-312838ef-8d82-463f-95ac-60202dc52135 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:23.853674 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-312838ef-8d82-463f-95ac-60202dc52135 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:23.860166 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Going to run 1 instances... {{(pid=122526) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:38:23.870087 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:38:23.945315 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-312838ef-8d82-463f-95ac-60202dc52135 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:23.987680 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-620195d6-dbd8-4f52-9713-492271abe5bd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.730490 Nov 11 20:38:23.987680 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 5/10] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:38:22 2021] POST /compute/v2.1/servers => generated 383 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:38:23.987680 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-30b5aa98-e412-42fc-afe7-95cee4b94617 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:23.987680 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-30b5aa98-e412-42fc-afe7-95cee4b94617 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:23.987680 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-30b5aa98-e412-42fc-afe7-95cee4b94617 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:23.993486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-30b5aa98-e412-42fc-afe7-95cee4b94617 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:23.993486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-30b5aa98-e412-42fc-afe7-95cee4b94617 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:23.993486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-30b5aa98-e412-42fc-afe7-95cee4b94617 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:24.016688 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-312838ef-8d82-463f-95ac-60202dc52135 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1211 microversion: 2.1 time: 0.174994 Nov 11 20:38:24.030979 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 6/11] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:23 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1211 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:24.049042 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-dbafa8ed-dccd-4a0f-9a86-8036aa006870 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:24.049877 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-dbafa8ed-dccd-4a0f-9a86-8036aa006870 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:24.230835 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-dbafa8ed-dccd-4a0f-9a86-8036aa006870 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:24.237759 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-dbafa8ed-dccd-4a0f-9a86-8036aa006870 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1222 microversion: 2.1 time: 0.205198 Nov 11 20:38:24.240464 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 7/12] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:24 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1222 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:24.308264 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-30b5aa98-e412-42fc-afe7-95cee4b94617 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:24.325011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-30b5aa98-e412-42fc-afe7-95cee4b94617 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1214 microversion: 2.1 time: 0.369519 Nov 11 20:38:24.326313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 6/13] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:23 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1214 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:24.461452 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-488559093", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acd422cb-07fc-4b63-aaab-fd2e52fc9069"}]}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:38:24.563892 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.network.neutron [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] validate_networks() for [('acd422cb-07fc-4b63-aaab-fd2e52fc9069', None, None, None, None, None)] {{(pid=122527) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:38:25.037917 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7a5be1c6-4b31-4db9-921a-6369e3cbb04b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:25.038557 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7a5be1c6-4b31-4db9-921a-6369e3cbb04b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:25.056307 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7a5be1c6-4b31-4db9-921a-6369e3cbb04b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:25.057114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7a5be1c6-4b31-4db9-921a-6369e3cbb04b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:25.058299 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7a5be1c6-4b31-4db9-921a-6369e3cbb04b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:25.061604 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7a5be1c6-4b31-4db9-921a-6369e3cbb04b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:25.259209 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7a5be1c6-4b31-4db9-921a-6369e3cbb04b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:25.266588 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7a5be1c6-4b31-4db9-921a-6369e3cbb04b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1211 microversion: 2.1 time: 0.233305 Nov 11 20:38:25.276804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 7/14] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:25 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1211 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:25.342511 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-13fd9004-010d-4302-8d18-493db8c7095c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:25.343124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-13fd9004-010d-4302-8d18-493db8c7095c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:25.349903 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13fd9004-010d-4302-8d18-493db8c7095c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:25.354217 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13fd9004-010d-4302-8d18-493db8c7095c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:25.355089 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13fd9004-010d-4302-8d18-493db8c7095c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:25.355544 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13fd9004-010d-4302-8d18-493db8c7095c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:25.477839 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-13fd9004-010d-4302-8d18-493db8c7095c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:25.494452 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-13fd9004-010d-4302-8d18-493db8c7095c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1214 microversion: 2.1 time: 0.155469 Nov 11 20:38:25.495320 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 8/15] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:25 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:25.546311 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Flavor limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:38:25.546780 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Image limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:38:25.547290 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Flavor pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:38:25.547706 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Image pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:38:25.548178 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:38:25.592264 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:25.593186 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:25.595112 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:25.599498 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:25.633672 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Getting quotas for project 8473830434694f05acc123584bf48e18. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:38:25.638707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Getting quotas for user 87f969040e0245d9a4894bd40ed8f72f and project 8473830434694f05acc123584bf48e18. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:38:25.669882 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Going to run 1 instances... {{(pid=122527) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:38:25.673451 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:38:25.725853 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8eb6cd75-5c2a-412d-b3a3-40639271546e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.271235 Nov 11 20:38:25.726602 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 8/16] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:38:24 2021] POST /compute/v2.1/servers => generated 383 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:38:25.738634 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-41e4dd22-7457-4cf0-8113-3eafad13721b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:25.739671 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-41e4dd22-7457-4cf0-8113-3eafad13721b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:25.824973 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-41e4dd22-7457-4cf0-8113-3eafad13721b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:25.836522 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-41e4dd22-7457-4cf0-8113-3eafad13721b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1221 microversion: 2.1 time: 0.102294 Nov 11 20:38:25.838294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 9/17] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:25 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:26.284267 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-cad138cc-ebd9-4258-a4ce-09957ce210cf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:26.285102 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-cad138cc-ebd9-4258-a4ce-09957ce210cf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:26.296733 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cad138cc-ebd9-4258-a4ce-09957ce210cf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:26.297198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cad138cc-ebd9-4258-a4ce-09957ce210cf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:26.298145 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cad138cc-ebd9-4258-a4ce-09957ce210cf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:26.300258 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cad138cc-ebd9-4258-a4ce-09957ce210cf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:26.511575 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-823f58ef-3d6d-4daf-9a89-ceba72e6b64f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:26.512982 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-823f58ef-3d6d-4daf-9a89-ceba72e6b64f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:26.523013 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-823f58ef-3d6d-4daf-9a89-ceba72e6b64f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:26.526045 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-823f58ef-3d6d-4daf-9a89-ceba72e6b64f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:26.526951 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-823f58ef-3d6d-4daf-9a89-ceba72e6b64f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:26.527405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-823f58ef-3d6d-4daf-9a89-ceba72e6b64f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:26.643717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-823f58ef-3d6d-4daf-9a89-ceba72e6b64f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:26.644811 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cad138cc-ebd9-4258-a4ce-09957ce210cf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:26.654436 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-823f58ef-3d6d-4daf-9a89-ceba72e6b64f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1214 microversion: 2.1 time: 0.147076 Nov 11 20:38:26.655365 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 10/18] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:26 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:26.656461 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-cad138cc-ebd9-4258-a4ce-09957ce210cf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1267 microversion: 2.1 time: 0.376102 Nov 11 20:38:26.665921 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 9/19] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:26 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1267 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:26.856338 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4d0527d9-7198-40ae-8a48-fbb94a87a277 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:26.857963 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4d0527d9-7198-40ae-8a48-fbb94a87a277 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:26.866682 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4d0527d9-7198-40ae-8a48-fbb94a87a277 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:26.867138 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4d0527d9-7198-40ae-8a48-fbb94a87a277 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:26.873632 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4d0527d9-7198-40ae-8a48-fbb94a87a277 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:26.874077 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4d0527d9-7198-40ae-8a48-fbb94a87a277 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:26.981414 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4d0527d9-7198-40ae-8a48-fbb94a87a277 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:26.989440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4d0527d9-7198-40ae-8a48-fbb94a87a277 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1217 microversion: 2.1 time: 0.138147 Nov 11 20:38:26.990347 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 11/20] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:26 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:27.172364 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1274907549", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51d362a5-52f5-4926-aac3-68c4c9326236"}], "security_groups": [{"name": "tempest-securitygroup--1788273689"}], "key_name": "tempest-keypair-288013805", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:38:27.352646 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.network.neutron [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] validate_networks() for [('51d362a5-52f5-4926-aac3-68c4c9326236', None, None, None, None, None)] {{(pid=122527) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:38:27.672351 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-35843a2b-d3f9-455c-9c9d-21d74f638986 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:27.672977 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-35843a2b-d3f9-455c-9c9d-21d74f638986 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:27.687719 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-35843a2b-d3f9-455c-9c9d-21d74f638986 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:27.688098 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-35843a2b-d3f9-455c-9c9d-21d74f638986 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:27.689079 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-35843a2b-d3f9-455c-9c9d-21d74f638986 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:27.689661 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-35843a2b-d3f9-455c-9c9d-21d74f638986 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:27.829479 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-35843a2b-d3f9-455c-9c9d-21d74f638986 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:27.841670 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-35843a2b-d3f9-455c-9c9d-21d74f638986 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1214 microversion: 2.1 time: 0.172832 Nov 11 20:38:27.854421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 12/21] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:27 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:27.861465 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-26d4ac86-eb74-4a4e-a4e2-568be67bec8b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:27.862301 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-26d4ac86-eb74-4a4e-a4e2-568be67bec8b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:27.872282 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-26d4ac86-eb74-4a4e-a4e2-568be67bec8b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:27.873212 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-26d4ac86-eb74-4a4e-a4e2-568be67bec8b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:27.874477 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-26d4ac86-eb74-4a4e-a4e2-568be67bec8b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:27.875446 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-26d4ac86-eb74-4a4e-a4e2-568be67bec8b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:28.041342 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-26d4ac86-eb74-4a4e-a4e2-568be67bec8b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:28.049850 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-26d4ac86-eb74-4a4e-a4e2-568be67bec8b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1267 microversion: 2.1 time: 0.193921 Nov 11 20:38:28.050446 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 13/22] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:27 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:28.061043 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7ef04401-0c45-4ca3-901d-3272d92d777f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:28.061667 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7ef04401-0c45-4ca3-901d-3272d92d777f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:28.080913 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7ef04401-0c45-4ca3-901d-3272d92d777f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:28.081466 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7ef04401-0c45-4ca3-901d-3272d92d777f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:28.083198 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7ef04401-0c45-4ca3-901d-3272d92d777f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:28.084262 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7ef04401-0c45-4ca3-901d-3272d92d777f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:28.096960 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Flavor limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:38:28.105788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Image limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:38:28.108547 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Flavor pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:38:28.109149 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Image pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:38:28.109730 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:38:28.119603 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:28.120334 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:28.122341 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:28.122753 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:28.142497 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Getting quotas for project 38d540a76ef9405bb94b7e433494fabd. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:38:28.147126 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Getting quotas for user c3e90865af2147c995fb58e24129d032 and project 38d540a76ef9405bb94b7e433494fabd. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:38:28.158536 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Going to run 1 instances... {{(pid=122527) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:38:28.160708 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:38:28.174733 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7ef04401-0c45-4ca3-901d-3272d92d777f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:28.183645 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7ef04401-0c45-4ca3-901d-3272d92d777f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1217 microversion: 2.1 time: 0.129255 Nov 11 20:38:28.184701 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 14/23] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:28 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:28.218482 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7051e6b3-f0b4-4c50-9d51-46be14630b58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.050252 Nov 11 20:38:28.225218 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 10/24] 10.222.0.61 () {62 vars in 1187 bytes} [Thu Nov 11 20:38:27 2021] POST /compute/v2.1/servers => generated 402 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 11 20:38:28.233086 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6e29b790-a867-44b7-8e2a-f5ba1979162f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:28.233759 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6e29b790-a867-44b7-8e2a-f5ba1979162f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:28.289025 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6e29b790-a867-44b7-8e2a-f5ba1979162f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:28.300988 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6e29b790-a867-44b7-8e2a-f5ba1979162f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:28.304491 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6e29b790-a867-44b7-8e2a-f5ba1979162f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:28.306599 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6e29b790-a867-44b7-8e2a-f5ba1979162f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1281 microversion: 2.20 time: 0.078906 Nov 11 20:38:28.317840 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 15/25] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:28 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:28.859792 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fbda0656-fd41-49bc-9ff2-a9a498440ec9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:28.860446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fbda0656-fd41-49bc-9ff2-a9a498440ec9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:28.867477 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fbda0656-fd41-49bc-9ff2-a9a498440ec9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:28.867929 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fbda0656-fd41-49bc-9ff2-a9a498440ec9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:28.868739 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fbda0656-fd41-49bc-9ff2-a9a498440ec9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:28.869177 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fbda0656-fd41-49bc-9ff2-a9a498440ec9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:28.935316 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-fbda0656-fd41-49bc-9ff2-a9a498440ec9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:28.945506 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fbda0656-fd41-49bc-9ff2-a9a498440ec9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1214 microversion: 2.1 time: 0.089283 Nov 11 20:38:28.952638 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 11/26] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:28 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:29.066911 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-97b60e35-7ef5-48fd-84d3-29933fe96532 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:29.067718 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-97b60e35-7ef5-48fd-84d3-29933fe96532 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:29.075615 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97b60e35-7ef5-48fd-84d3-29933fe96532 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:29.076114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97b60e35-7ef5-48fd-84d3-29933fe96532 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:29.076916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97b60e35-7ef5-48fd-84d3-29933fe96532 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:29.077361 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97b60e35-7ef5-48fd-84d3-29933fe96532 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:29.174593 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-97b60e35-7ef5-48fd-84d3-29933fe96532 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:29.182601 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-97b60e35-7ef5-48fd-84d3-29933fe96532 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1267 microversion: 2.1 time: 0.119543 Nov 11 20:38:29.183596 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 16/27] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:29 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1267 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:29.201809 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-70a6440b-1dab-4a39-91e0-abd482493d9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:29.203301 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-70a6440b-1dab-4a39-91e0-abd482493d9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:29.210566 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-70a6440b-1dab-4a39-91e0-abd482493d9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:29.211061 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-70a6440b-1dab-4a39-91e0-abd482493d9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:29.211912 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-70a6440b-1dab-4a39-91e0-abd482493d9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:29.212407 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-70a6440b-1dab-4a39-91e0-abd482493d9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:29.286783 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-70a6440b-1dab-4a39-91e0-abd482493d9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:29.296672 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-70a6440b-1dab-4a39-91e0-abd482493d9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1217 microversion: 2.1 time: 0.098998 Nov 11 20:38:29.304071 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 12/28] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:29 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:29.326250 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bee1d730-6c4a-433e-be70-57c5739ff961 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:29.326844 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-bee1d730-6c4a-433e-be70-57c5739ff961 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:29.333923 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bee1d730-6c4a-433e-be70-57c5739ff961 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:29.334729 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bee1d730-6c4a-433e-be70-57c5739ff961 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:29.335510 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bee1d730-6c4a-433e-be70-57c5739ff961 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:29.336574 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bee1d730-6c4a-433e-be70-57c5739ff961 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:29.421585 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-bee1d730-6c4a-433e-be70-57c5739ff961 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:29.436481 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-bee1d730-6c4a-433e-be70-57c5739ff961 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:29.439037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-bee1d730-6c4a-433e-be70-57c5739ff961 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:29.440666 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bee1d730-6c4a-433e-be70-57c5739ff961 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1285 microversion: 2.20 time: 0.118897 Nov 11 20:38:29.453178 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 17/29] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:29 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:29.963180 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4abcae1d-c4ec-40b9-bdbc-e284bfb84bd8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:29.963897 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4abcae1d-c4ec-40b9-bdbc-e284bfb84bd8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:29.972412 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4abcae1d-c4ec-40b9-bdbc-e284bfb84bd8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:29.977198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4abcae1d-c4ec-40b9-bdbc-e284bfb84bd8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:29.978143 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4abcae1d-c4ec-40b9-bdbc-e284bfb84bd8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:29.978716 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4abcae1d-c4ec-40b9-bdbc-e284bfb84bd8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:30.059859 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-4abcae1d-c4ec-40b9-bdbc-e284bfb84bd8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:30.068949 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4abcae1d-c4ec-40b9-bdbc-e284bfb84bd8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1270 microversion: 2.1 time: 0.110919 Nov 11 20:38:30.069517 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 13/30] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:29 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:30.200924 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a7b76adf-7899-4c39-8a89-41ff86cf39b1 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:30.203442 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a7b76adf-7899-4c39-8a89-41ff86cf39b1 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:30.227206 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a7b76adf-7899-4c39-8a89-41ff86cf39b1 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:30.227659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a7b76adf-7899-4c39-8a89-41ff86cf39b1 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:30.228476 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a7b76adf-7899-4c39-8a89-41ff86cf39b1 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:30.228907 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a7b76adf-7899-4c39-8a89-41ff86cf39b1 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:30.315328 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-dc727c1f-40a2-402d-bbbe-82f2ddca0da0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:30.315943 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-dc727c1f-40a2-402d-bbbe-82f2ddca0da0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:30.346579 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dc727c1f-40a2-402d-bbbe-82f2ddca0da0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:30.347493 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dc727c1f-40a2-402d-bbbe-82f2ddca0da0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:30.349638 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dc727c1f-40a2-402d-bbbe-82f2ddca0da0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:30.352804 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dc727c1f-40a2-402d-bbbe-82f2ddca0da0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:30.598859 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a7b76adf-7899-4c39-8a89-41ff86cf39b1 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:30.610686 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a7b76adf-7899-4c39-8a89-41ff86cf39b1 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1273 microversion: 2.1 time: 0.414262 Nov 11 20:38:30.612013 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 18/31] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:30 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1273 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:30.624831 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e8717ea6-fd5f-4931-a033-d6e5dab53f98 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:30.625769 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e8717ea6-fd5f-4931-a033-d6e5dab53f98 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:30.639185 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-dc727c1f-40a2-402d-bbbe-82f2ddca0da0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:30.642616 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8717ea6-fd5f-4931-a033-d6e5dab53f98 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:30.646782 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-dc727c1f-40a2-402d-bbbe-82f2ddca0da0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1217 microversion: 2.1 time: 0.336238 Nov 11 20:38:30.647372 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 14/32] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:30 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1217 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:30.656177 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8717ea6-fd5f-4931-a033-d6e5dab53f98 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:30.656177 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8717ea6-fd5f-4931-a033-d6e5dab53f98 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:30.656177 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8717ea6-fd5f-4931-a033-d6e5dab53f98 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:30.856484 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e8717ea6-fd5f-4931-a033-d6e5dab53f98 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:30.883373 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e8717ea6-fd5f-4931-a033-d6e5dab53f98 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:30.899930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e8717ea6-fd5f-4931-a033-d6e5dab53f98 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:30.908415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e8717ea6-fd5f-4931-a033-d6e5dab53f98 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.288281 Nov 11 20:38:30.911007 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 19/33] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:30 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:31.090454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e601f813-6863-4b11-bad1-b9f1aab37a01 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:31.091508 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e601f813-6863-4b11-bad1-b9f1aab37a01 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:31.107145 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e601f813-6863-4b11-bad1-b9f1aab37a01 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:31.107604 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e601f813-6863-4b11-bad1-b9f1aab37a01 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:31.108666 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e601f813-6863-4b11-bad1-b9f1aab37a01 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:31.109095 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e601f813-6863-4b11-bad1-b9f1aab37a01 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:31.245448 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e601f813-6863-4b11-bad1-b9f1aab37a01 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:31.259159 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e601f813-6863-4b11-bad1-b9f1aab37a01 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1276 microversion: 2.1 time: 0.175488 Nov 11 20:38:31.261229 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 15/34] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:31 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:31.628979 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f821e5e9-3727-4a7f-a483-fbced0d9fcaa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:31.630162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f821e5e9-3727-4a7f-a483-fbced0d9fcaa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:31.638287 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f821e5e9-3727-4a7f-a483-fbced0d9fcaa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:31.639125 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f821e5e9-3727-4a7f-a483-fbced0d9fcaa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:31.641577 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f821e5e9-3727-4a7f-a483-fbced0d9fcaa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:31.642869 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f821e5e9-3727-4a7f-a483-fbced0d9fcaa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:31.679263 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-032af0aa-2f36-49f0-a5e4-c9649cc4f213 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:31.681445 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-032af0aa-2f36-49f0-a5e4-c9649cc4f213 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:31.717622 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-032af0aa-2f36-49f0-a5e4-c9649cc4f213 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:31.719096 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-032af0aa-2f36-49f0-a5e4-c9649cc4f213 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:31.721506 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-032af0aa-2f36-49f0-a5e4-c9649cc4f213 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:31.722389 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-032af0aa-2f36-49f0-a5e4-c9649cc4f213 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:31.890067 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-032af0aa-2f36-49f0-a5e4-c9649cc4f213 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:31.898937 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-032af0aa-2f36-49f0-a5e4-c9649cc4f213 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1273 microversion: 2.1 time: 0.236720 Nov 11 20:38:31.904036 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 16/35] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:31 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:31.931381 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-77a21208-7c9c-4bd5-a7d5-e9e1db1f62c8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:31.932292 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-77a21208-7c9c-4bd5-a7d5-e9e1db1f62c8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:31.945129 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-77a21208-7c9c-4bd5-a7d5-e9e1db1f62c8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:31.946180 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-77a21208-7c9c-4bd5-a7d5-e9e1db1f62c8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:31.948275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-77a21208-7c9c-4bd5-a7d5-e9e1db1f62c8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:31.948929 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-77a21208-7c9c-4bd5-a7d5-e9e1db1f62c8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:32.233802 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-77a21208-7c9c-4bd5-a7d5-e9e1db1f62c8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:32.249049 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-77a21208-7c9c-4bd5-a7d5-e9e1db1f62c8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:32.250881 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-77a21208-7c9c-4bd5-a7d5-e9e1db1f62c8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:32.256168 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-77a21208-7c9c-4bd5-a7d5-e9e1db1f62c8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.328266 Nov 11 20:38:32.256893 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 17/36] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:31 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:38:32.284745 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6ab6ab69-10da-4c7f-80c0-90f587a24af0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:32.285890 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6ab6ab69-10da-4c7f-80c0-90f587a24af0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:32.296555 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6ab6ab69-10da-4c7f-80c0-90f587a24af0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:32.298535 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6ab6ab69-10da-4c7f-80c0-90f587a24af0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:32.300464 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6ab6ab69-10da-4c7f-80c0-90f587a24af0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:32.302075 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6ab6ab69-10da-4c7f-80c0-90f587a24af0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:32.330418 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f821e5e9-3727-4a7f-a483-fbced0d9fcaa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:32.342342 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f821e5e9-3727-4a7f-a483-fbced0d9fcaa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.716993 Nov 11 20:38:32.352167 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 20/37] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:31 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:32.428902 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-6ab6ab69-10da-4c7f-80c0-90f587a24af0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:32.442641 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6ab6ab69-10da-4c7f-80c0-90f587a24af0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1276 microversion: 2.1 time: 0.164416 Nov 11 20:38:32.443543 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 18/38] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:32 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:32.925607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3c4eb127-e28b-4415-bd68-14eedf78a9ef tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:32.926612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3c4eb127-e28b-4415-bd68-14eedf78a9ef tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:32.933054 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3c4eb127-e28b-4415-bd68-14eedf78a9ef tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:32.933516 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3c4eb127-e28b-4415-bd68-14eedf78a9ef tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:32.934304 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3c4eb127-e28b-4415-bd68-14eedf78a9ef tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:32.934782 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3c4eb127-e28b-4415-bd68-14eedf78a9ef tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:33.002036 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3c4eb127-e28b-4415-bd68-14eedf78a9ef tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:33.009945 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3c4eb127-e28b-4415-bd68-14eedf78a9ef tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1273 microversion: 2.1 time: 0.087912 Nov 11 20:38:33.011543 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 21/39] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:32 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:33.275557 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a3cd55e7-e7e8-478f-a176-ba9013660f73 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:33.276207 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a3cd55e7-e7e8-478f-a176-ba9013660f73 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:33.282302 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a3cd55e7-e7e8-478f-a176-ba9013660f73 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:33.282799 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a3cd55e7-e7e8-478f-a176-ba9013660f73 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:33.284154 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a3cd55e7-e7e8-478f-a176-ba9013660f73 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:33.284579 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a3cd55e7-e7e8-478f-a176-ba9013660f73 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:33.360362 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-86d1faa0-09ec-4565-8eff-447875c2a36c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:33.361063 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-86d1faa0-09ec-4565-8eff-447875c2a36c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:33.361511 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a3cd55e7-e7e8-478f-a176-ba9013660f73 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:33.370250 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-86d1faa0-09ec-4565-8eff-447875c2a36c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:33.370848 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-86d1faa0-09ec-4565-8eff-447875c2a36c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:33.371852 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-86d1faa0-09ec-4565-8eff-447875c2a36c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:33.372460 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-86d1faa0-09ec-4565-8eff-447875c2a36c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:33.381417 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a3cd55e7-e7e8-478f-a176-ba9013660f73 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:33.383328 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a3cd55e7-e7e8-478f-a176-ba9013660f73 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:33.384692 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a3cd55e7-e7e8-478f-a176-ba9013660f73 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.113882 Nov 11 20:38:33.385807 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 19/40] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:33 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:33.462290 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ff730344-326a-476d-a4e1-d50a5809e81d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:33.463632 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ff730344-326a-476d-a4e1-d50a5809e81d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:33.470824 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ff730344-326a-476d-a4e1-d50a5809e81d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:33.471553 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ff730344-326a-476d-a4e1-d50a5809e81d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:33.472568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ff730344-326a-476d-a4e1-d50a5809e81d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:33.473230 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ff730344-326a-476d-a4e1-d50a5809e81d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:33.612667 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-86d1faa0-09ec-4565-8eff-447875c2a36c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:33.625471 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-86d1faa0-09ec-4565-8eff-447875c2a36c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.270255 Nov 11 20:38:33.638137 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 22/41] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:33 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:33.760791 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ff730344-326a-476d-a4e1-d50a5809e81d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:33.769115 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ff730344-326a-476d-a4e1-d50a5809e81d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.312040 Nov 11 20:38:33.772541 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 20/42] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:33 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:34.028301 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-98de72b0-9310-4708-aa1e-6af50e233160 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:34.030873 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-98de72b0-9310-4708-aa1e-6af50e233160 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:34.038682 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-98de72b0-9310-4708-aa1e-6af50e233160 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:34.040343 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-98de72b0-9310-4708-aa1e-6af50e233160 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:34.041155 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-98de72b0-9310-4708-aa1e-6af50e233160 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:34.041609 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-98de72b0-9310-4708-aa1e-6af50e233160 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:34.115416 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-98de72b0-9310-4708-aa1e-6af50e233160 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:34.139596 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-98de72b0-9310-4708-aa1e-6af50e233160 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1273 microversion: 2.1 time: 0.116608 Nov 11 20:38:34.140475 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 23/43] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:34 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:34.407196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-39d87085-2d2e-4bea-bc19-5791891bec30 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:34.408739 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-39d87085-2d2e-4bea-bc19-5791891bec30 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:34.416617 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-39d87085-2d2e-4bea-bc19-5791891bec30 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:34.417218 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-39d87085-2d2e-4bea-bc19-5791891bec30 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:34.418763 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-39d87085-2d2e-4bea-bc19-5791891bec30 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:34.419761 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-39d87085-2d2e-4bea-bc19-5791891bec30 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:34.485771 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-39d87085-2d2e-4bea-bc19-5791891bec30 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:34.495471 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-39d87085-2d2e-4bea-bc19-5791891bec30 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:34.497048 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-39d87085-2d2e-4bea-bc19-5791891bec30 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:34.498336 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-39d87085-2d2e-4bea-bc19-5791891bec30 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.096173 Nov 11 20:38:34.499056 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 21/44] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:34 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:34.643547 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9f2d7c1e-bded-4361-a686-726b46498b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:34.644294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9f2d7c1e-bded-4361-a686-726b46498b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:34.650314 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9f2d7c1e-bded-4361-a686-726b46498b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:34.650843 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9f2d7c1e-bded-4361-a686-726b46498b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:34.651919 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9f2d7c1e-bded-4361-a686-726b46498b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:34.652512 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9f2d7c1e-bded-4361-a686-726b46498b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:34.791490 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-864ad1d6-edd4-4a47-ba25-25f092191c43 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:34.792235 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-864ad1d6-edd4-4a47-ba25-25f092191c43 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:34.798213 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-864ad1d6-edd4-4a47-ba25-25f092191c43 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:34.798674 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-864ad1d6-edd4-4a47-ba25-25f092191c43 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:34.799458 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-864ad1d6-edd4-4a47-ba25-25f092191c43 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:34.799895 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-864ad1d6-edd4-4a47-ba25-25f092191c43 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:34.807837 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9f2d7c1e-bded-4361-a686-726b46498b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:34.815036 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9f2d7c1e-bded-4361-a686-726b46498b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.175166 Nov 11 20:38:34.815771 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 24/45] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:34 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:34.951191 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-864ad1d6-edd4-4a47-ba25-25f092191c43 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:34.958810 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-864ad1d6-edd4-4a47-ba25-25f092191c43 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.171236 Nov 11 20:38:34.959390 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 22/46] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:34 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:35.158878 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-12bb7384-da83-43be-9cbd-7e1ac54a27eb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:35.159715 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-12bb7384-da83-43be-9cbd-7e1ac54a27eb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:35.172903 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-12bb7384-da83-43be-9cbd-7e1ac54a27eb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:35.175627 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-12bb7384-da83-43be-9cbd-7e1ac54a27eb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:35.177006 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-12bb7384-da83-43be-9cbd-7e1ac54a27eb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:35.179483 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-12bb7384-da83-43be-9cbd-7e1ac54a27eb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:35.282408 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-12bb7384-da83-43be-9cbd-7e1ac54a27eb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:35.292224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-12bb7384-da83-43be-9cbd-7e1ac54a27eb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1273 microversion: 2.1 time: 0.137616 Nov 11 20:38:35.292811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 25/47] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:35 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:35.518995 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b2ad28a7-3bf2-47ad-bb72-819b3083b55e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:35.519570 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b2ad28a7-3bf2-47ad-bb72-819b3083b55e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:35.532550 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2ad28a7-3bf2-47ad-bb72-819b3083b55e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:35.533719 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2ad28a7-3bf2-47ad-bb72-819b3083b55e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:35.534672 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2ad28a7-3bf2-47ad-bb72-819b3083b55e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:35.535454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2ad28a7-3bf2-47ad-bb72-819b3083b55e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:35.603314 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b2ad28a7-3bf2-47ad-bb72-819b3083b55e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:35.610993 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b2ad28a7-3bf2-47ad-bb72-819b3083b55e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:35.612613 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b2ad28a7-3bf2-47ad-bb72-819b3083b55e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:35.613994 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b2ad28a7-3bf2-47ad-bb72-819b3083b55e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.099366 Nov 11 20:38:35.614550 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 23/48] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:35 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:38:35.835023 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f673437b-c509-47e4-8e8f-9475c590a88d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:35.835775 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f673437b-c509-47e4-8e8f-9475c590a88d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:35.842926 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f673437b-c509-47e4-8e8f-9475c590a88d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:35.843540 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f673437b-c509-47e4-8e8f-9475c590a88d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:35.844582 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f673437b-c509-47e4-8e8f-9475c590a88d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:35.845105 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f673437b-c509-47e4-8e8f-9475c590a88d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:35.980034 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2c706796-aad5-4866-be51-9c5625593092 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:35.981477 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2c706796-aad5-4866-be51-9c5625593092 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:35.996437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2c706796-aad5-4866-be51-9c5625593092 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:35.998941 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2c706796-aad5-4866-be51-9c5625593092 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:36.000930 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2c706796-aad5-4866-be51-9c5625593092 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:36.001637 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2c706796-aad5-4866-be51-9c5625593092 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:36.031820 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f673437b-c509-47e4-8e8f-9475c590a88d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:36.040331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f673437b-c509-47e4-8e8f-9475c590a88d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.209028 Nov 11 20:38:36.040837 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 26/49] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:35 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:36.202640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-2c706796-aad5-4866-be51-9c5625593092 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:36.211165 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2c706796-aad5-4866-be51-9c5625593092 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.239190 Nov 11 20:38:36.212354 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 24/50] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:35 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:36.308900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1ace3c74-0fdf-4133-99db-56ca3f8496a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:36.309662 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1ace3c74-0fdf-4133-99db-56ca3f8496a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:36.316022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1ace3c74-0fdf-4133-99db-56ca3f8496a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:36.316594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1ace3c74-0fdf-4133-99db-56ca3f8496a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:36.317467 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1ace3c74-0fdf-4133-99db-56ca3f8496a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:36.317972 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1ace3c74-0fdf-4133-99db-56ca3f8496a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:36.384204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1ace3c74-0fdf-4133-99db-56ca3f8496a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:36.397137 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1ace3c74-0fdf-4133-99db-56ca3f8496a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1273 microversion: 2.1 time: 0.091665 Nov 11 20:38:36.397966 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 27/51] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:36 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:36.632570 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f5944d7b-7046-4307-990d-392bc849d123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:36.633271 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f5944d7b-7046-4307-990d-392bc849d123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:36.639130 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f5944d7b-7046-4307-990d-392bc849d123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:36.639581 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f5944d7b-7046-4307-990d-392bc849d123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:36.640420 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f5944d7b-7046-4307-990d-392bc849d123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:36.640859 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f5944d7b-7046-4307-990d-392bc849d123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:36.705490 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f5944d7b-7046-4307-990d-392bc849d123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:36.714786 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f5944d7b-7046-4307-990d-392bc849d123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:36.716358 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f5944d7b-7046-4307-990d-392bc849d123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:36.717449 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f5944d7b-7046-4307-990d-392bc849d123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.089508 Nov 11 20:38:36.718014 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 25/52] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:36 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:37.056439 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4e09de7d-3541-4d79-aacf-6eb898cde798 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:37.057275 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4e09de7d-3541-4d79-aacf-6eb898cde798 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:37.063623 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4e09de7d-3541-4d79-aacf-6eb898cde798 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:37.064108 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4e09de7d-3541-4d79-aacf-6eb898cde798 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:37.064887 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4e09de7d-3541-4d79-aacf-6eb898cde798 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:37.065370 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4e09de7d-3541-4d79-aacf-6eb898cde798 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:37.202697 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4e09de7d-3541-4d79-aacf-6eb898cde798 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:37.215307 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4e09de7d-3541-4d79-aacf-6eb898cde798 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.162579 Nov 11 20:38:37.215893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 28/53] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:37 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:37.230503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-23b2a255-c858-4670-bebb-0e5daad75096 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:37.231451 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-23b2a255-c858-4670-bebb-0e5daad75096 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:37.242233 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-23b2a255-c858-4670-bebb-0e5daad75096 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:37.243438 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-23b2a255-c858-4670-bebb-0e5daad75096 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:37.244930 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-23b2a255-c858-4670-bebb-0e5daad75096 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:37.245591 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-23b2a255-c858-4670-bebb-0e5daad75096 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:37.409928 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-23b2a255-c858-4670-bebb-0e5daad75096 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:37.415125 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-400f05b5-e653-4b1d-8c8e-d9d09c64f24b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:37.415825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-400f05b5-e653-4b1d-8c8e-d9d09c64f24b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:37.418735 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-23b2a255-c858-4670-bebb-0e5daad75096 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.193915 Nov 11 20:38:37.419385 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 26/54] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:37 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:37.429010 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-400f05b5-e653-4b1d-8c8e-d9d09c64f24b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:37.429010 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-400f05b5-e653-4b1d-8c8e-d9d09c64f24b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:37.429010 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-400f05b5-e653-4b1d-8c8e-d9d09c64f24b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:37.429010 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-400f05b5-e653-4b1d-8c8e-d9d09c64f24b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:37.508454 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-400f05b5-e653-4b1d-8c8e-d9d09c64f24b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:37.515900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-400f05b5-e653-4b1d-8c8e-d9d09c64f24b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1273 microversion: 2.1 time: 0.104862 Nov 11 20:38:37.517429 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 29/55] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:37 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:37.739846 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-63028b41-492d-4a9d-9281-913f08e0f086 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:37.742438 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-63028b41-492d-4a9d-9281-913f08e0f086 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:37.750971 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-63028b41-492d-4a9d-9281-913f08e0f086 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:37.751255 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-63028b41-492d-4a9d-9281-913f08e0f086 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:37.752670 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-63028b41-492d-4a9d-9281-913f08e0f086 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:37.754267 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-63028b41-492d-4a9d-9281-913f08e0f086 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:37.895334 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-63028b41-492d-4a9d-9281-913f08e0f086 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:37.903935 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-63028b41-492d-4a9d-9281-913f08e0f086 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:37.905500 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-63028b41-492d-4a9d-9281-913f08e0f086 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:37.906632 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-63028b41-492d-4a9d-9281-913f08e0f086 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.172916 Nov 11 20:38:37.907162 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 27/56] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:37 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:38.232403 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a072f4fd-cb0a-4d68-afac-cfb304469996 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:38.233288 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a072f4fd-cb0a-4d68-afac-cfb304469996 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:38.239573 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a072f4fd-cb0a-4d68-afac-cfb304469996 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:38.240473 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a072f4fd-cb0a-4d68-afac-cfb304469996 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:38.241594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a072f4fd-cb0a-4d68-afac-cfb304469996 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:38.242176 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a072f4fd-cb0a-4d68-afac-cfb304469996 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:38.405749 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a072f4fd-cb0a-4d68-afac-cfb304469996 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:38.415963 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a072f4fd-cb0a-4d68-afac-cfb304469996 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.187135 Nov 11 20:38:38.421083 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 30/57] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:38 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:38.440326 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0955f606-b5ae-4d21-bb9e-2a4379a1d8f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:38.440946 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0955f606-b5ae-4d21-bb9e-2a4379a1d8f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:38.461996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0955f606-b5ae-4d21-bb9e-2a4379a1d8f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:38.462505 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0955f606-b5ae-4d21-bb9e-2a4379a1d8f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:38.463357 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0955f606-b5ae-4d21-bb9e-2a4379a1d8f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:38.463784 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0955f606-b5ae-4d21-bb9e-2a4379a1d8f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:38.534008 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8da02cdf-3deb-4ee1-a4b9-61ff2dc10479 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:38.534793 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8da02cdf-3deb-4ee1-a4b9-61ff2dc10479 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:38.546252 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8da02cdf-3deb-4ee1-a4b9-61ff2dc10479 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:38.549224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8da02cdf-3deb-4ee1-a4b9-61ff2dc10479 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:38.550588 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8da02cdf-3deb-4ee1-a4b9-61ff2dc10479 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:38.553134 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8da02cdf-3deb-4ee1-a4b9-61ff2dc10479 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:38.649717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8da02cdf-3deb-4ee1-a4b9-61ff2dc10479 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:38.656861 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0955f606-b5ae-4d21-bb9e-2a4379a1d8f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:38.661841 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8da02cdf-3deb-4ee1-a4b9-61ff2dc10479 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1273 microversion: 2.1 time: 0.131375 Nov 11 20:38:38.662427 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 31/58] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:38 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:38.668179 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0955f606-b5ae-4d21-bb9e-2a4379a1d8f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.235001 Nov 11 20:38:38.678232 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 28/59] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:38 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:38.934101 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3d9ca26a-c956-4931-b159-0ef7f9d3e0f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:38.935058 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3d9ca26a-c956-4931-b159-0ef7f9d3e0f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:38.942674 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3d9ca26a-c956-4931-b159-0ef7f9d3e0f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:38.943302 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3d9ca26a-c956-4931-b159-0ef7f9d3e0f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:38.944320 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3d9ca26a-c956-4931-b159-0ef7f9d3e0f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:38.944939 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3d9ca26a-c956-4931-b159-0ef7f9d3e0f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:39.017636 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3d9ca26a-c956-4931-b159-0ef7f9d3e0f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:39.025881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3d9ca26a-c956-4931-b159-0ef7f9d3e0f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:39.028153 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3d9ca26a-c956-4931-b159-0ef7f9d3e0f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:39.029512 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3d9ca26a-c956-4931-b159-0ef7f9d3e0f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.099287 Nov 11 20:38:39.030457 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 32/60] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:38 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:39.433326 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-995ec8b8-ec12-4876-b0ab-9dff14646592 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:39.433923 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-995ec8b8-ec12-4876-b0ab-9dff14646592 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:39.440215 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-995ec8b8-ec12-4876-b0ab-9dff14646592 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:39.440881 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-995ec8b8-ec12-4876-b0ab-9dff14646592 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:39.442356 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-995ec8b8-ec12-4876-b0ab-9dff14646592 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:39.442789 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-995ec8b8-ec12-4876-b0ab-9dff14646592 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:39.636650 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-995ec8b8-ec12-4876-b0ab-9dff14646592 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:39.645687 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-995ec8b8-ec12-4876-b0ab-9dff14646592 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.215816 Nov 11 20:38:39.648123 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 29/61] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:39 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:39.682314 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ed22f66e-8f75-41df-a6a6-a9c5afe92446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:39.682930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ed22f66e-8f75-41df-a6a6-a9c5afe92446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:39.689040 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ed22f66e-8f75-41df-a6a6-a9c5afe92446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:39.690460 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ed22f66e-8f75-41df-a6a6-a9c5afe92446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:39.691493 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ed22f66e-8f75-41df-a6a6-a9c5afe92446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:39.694549 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d68e837e-0234-472a-b71e-58e4af7d2405 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:39.694834 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ed22f66e-8f75-41df-a6a6-a9c5afe92446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:39.696885 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d68e837e-0234-472a-b71e-58e4af7d2405 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:39.709257 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d68e837e-0234-472a-b71e-58e4af7d2405 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:39.709591 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d68e837e-0234-472a-b71e-58e4af7d2405 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:39.710478 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d68e837e-0234-472a-b71e-58e4af7d2405 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:39.711536 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d68e837e-0234-472a-b71e-58e4af7d2405 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:39.789440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ed22f66e-8f75-41df-a6a6-a9c5afe92446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:39.798400 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ed22f66e-8f75-41df-a6a6-a9c5afe92446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1273 microversion: 2.1 time: 0.119826 Nov 11 20:38:39.799040 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 33/62] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:39 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:39.935936 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d68e837e-0234-472a-b71e-58e4af7d2405 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:39.945479 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d68e837e-0234-472a-b71e-58e4af7d2405 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.260231 Nov 11 20:38:39.946177 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 30/63] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:39 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:40.047783 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-510afb10-a143-44cd-92a1-a00c35526123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:40.048567 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-510afb10-a143-44cd-92a1-a00c35526123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:40.055427 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-510afb10-a143-44cd-92a1-a00c35526123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:40.055868 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-510afb10-a143-44cd-92a1-a00c35526123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:40.056662 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-510afb10-a143-44cd-92a1-a00c35526123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:40.057084 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-510afb10-a143-44cd-92a1-a00c35526123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:40.118257 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-510afb10-a143-44cd-92a1-a00c35526123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:40.126059 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-510afb10-a143-44cd-92a1-a00c35526123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:40.127547 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-510afb10-a143-44cd-92a1-a00c35526123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:40.128669 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-510afb10-a143-44cd-92a1-a00c35526123 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.084720 Nov 11 20:38:40.129351 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 34/64] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:40 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:40.664218 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b6475191-83eb-4a69-b858-c5d23bbc4f78 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:40.664832 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b6475191-83eb-4a69-b858-c5d23bbc4f78 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:40.671757 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b6475191-83eb-4a69-b858-c5d23bbc4f78 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:40.671757 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b6475191-83eb-4a69-b858-c5d23bbc4f78 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:40.672283 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b6475191-83eb-4a69-b858-c5d23bbc4f78 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:40.672922 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b6475191-83eb-4a69-b858-c5d23bbc4f78 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:40.818012 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-080b83be-dc5c-484c-9577-11da7c689f45 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:40.819463 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-080b83be-dc5c-484c-9577-11da7c689f45 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:40.827095 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-080b83be-dc5c-484c-9577-11da7c689f45 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:40.827783 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-080b83be-dc5c-484c-9577-11da7c689f45 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:40.828612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-080b83be-dc5c-484c-9577-11da7c689f45 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:40.829056 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-080b83be-dc5c-484c-9577-11da7c689f45 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:40.852860 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b6475191-83eb-4a69-b858-c5d23bbc4f78 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:40.860112 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b6475191-83eb-4a69-b858-c5d23bbc4f78 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.201514 Nov 11 20:38:40.860679 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 31/65] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:40 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:40.903917 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-080b83be-dc5c-484c-9577-11da7c689f45 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:40.914603 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-080b83be-dc5c-484c-9577-11da7c689f45 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1273 microversion: 2.1 time: 0.101792 Nov 11 20:38:40.915100 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 35/66] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:40 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:40.965550 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6f4035cf-1cc5-4e59-9a83-12e785eb5093 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:40.967115 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6f4035cf-1cc5-4e59-9a83-12e785eb5093 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:40.979550 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f4035cf-1cc5-4e59-9a83-12e785eb5093 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:40.980164 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f4035cf-1cc5-4e59-9a83-12e785eb5093 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:40.981143 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f4035cf-1cc5-4e59-9a83-12e785eb5093 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:40.981627 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f4035cf-1cc5-4e59-9a83-12e785eb5093 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:41.124647 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-6f4035cf-1cc5-4e59-9a83-12e785eb5093 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:41.131883 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6f4035cf-1cc5-4e59-9a83-12e785eb5093 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.171842 Nov 11 20:38:41.132483 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 32/67] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:40 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:41.147189 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3e3042b0-ab69-4b91-a857-876ee213ae20 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:41.147788 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3e3042b0-ab69-4b91-a857-876ee213ae20 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:41.153632 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3e3042b0-ab69-4b91-a857-876ee213ae20 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:41.154075 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3e3042b0-ab69-4b91-a857-876ee213ae20 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:41.154837 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3e3042b0-ab69-4b91-a857-876ee213ae20 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:41.155261 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3e3042b0-ab69-4b91-a857-876ee213ae20 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:41.216953 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3e3042b0-ab69-4b91-a857-876ee213ae20 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:41.225505 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3e3042b0-ab69-4b91-a857-876ee213ae20 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:41.226996 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3e3042b0-ab69-4b91-a857-876ee213ae20 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:41.228121 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3e3042b0-ab69-4b91-a857-876ee213ae20 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.085148 Nov 11 20:38:41.228679 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 36/68] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:41 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:41.881093 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-93307754-b282-4a6e-873c-c3c429201b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:41.882283 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-93307754-b282-4a6e-873c-c3c429201b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:41.888296 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-93307754-b282-4a6e-873c-c3c429201b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:41.888748 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-93307754-b282-4a6e-873c-c3c429201b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:41.889559 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-93307754-b282-4a6e-873c-c3c429201b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:41.889995 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-93307754-b282-4a6e-873c-c3c429201b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:41.932441 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-90fff9e9-4bad-4a4c-b325-aca27c36da5a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:41.933174 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-90fff9e9-4bad-4a4c-b325-aca27c36da5a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:41.948278 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90fff9e9-4bad-4a4c-b325-aca27c36da5a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:41.948862 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90fff9e9-4bad-4a4c-b325-aca27c36da5a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:41.949777 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90fff9e9-4bad-4a4c-b325-aca27c36da5a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:41.950299 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90fff9e9-4bad-4a4c-b325-aca27c36da5a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:42.032971 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-90fff9e9-4bad-4a4c-b325-aca27c36da5a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:42.042192 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-90fff9e9-4bad-4a4c-b325-aca27c36da5a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1273 microversion: 2.1 time: 0.113492 Nov 11 20:38:42.042778 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 37/69] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:41 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:42.070628 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-93307754-b282-4a6e-873c-c3c429201b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:42.077992 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-93307754-b282-4a6e-873c-c3c429201b35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.201622 Nov 11 20:38:42.078540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 33/70] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:41 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:42.150301 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a827e944-d540-4719-8db3-56232be45836 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:42.150895 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a827e944-d540-4719-8db3-56232be45836 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:42.156735 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a827e944-d540-4719-8db3-56232be45836 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:42.157172 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a827e944-d540-4719-8db3-56232be45836 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:42.157930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a827e944-d540-4719-8db3-56232be45836 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:42.158353 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a827e944-d540-4719-8db3-56232be45836 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:42.245599 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-dea401e0-6a2f-4033-91ca-5d6b65428d2d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:42.246189 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-dea401e0-6a2f-4033-91ca-5d6b65428d2d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:42.251898 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dea401e0-6a2f-4033-91ca-5d6b65428d2d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:42.252370 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dea401e0-6a2f-4033-91ca-5d6b65428d2d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:42.253135 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dea401e0-6a2f-4033-91ca-5d6b65428d2d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:42.253563 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dea401e0-6a2f-4033-91ca-5d6b65428d2d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:42.299055 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a827e944-d540-4719-8db3-56232be45836 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:42.306320 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a827e944-d540-4719-8db3-56232be45836 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.160086 Nov 11 20:38:42.306882 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 38/71] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:42 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:42.321376 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-dea401e0-6a2f-4033-91ca-5d6b65428d2d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:42.326332 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-dea401e0-6a2f-4033-91ca-5d6b65428d2d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:42.327873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-dea401e0-6a2f-4033-91ca-5d6b65428d2d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:42.329215 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-dea401e0-6a2f-4033-91ca-5d6b65428d2d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.087242 Nov 11 20:38:42.329767 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 34/72] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:42 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:38:43.058358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-baef1c19-ac73-4ed7-a2ca-19deebbf3fc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:43.058966 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-baef1c19-ac73-4ed7-a2ca-19deebbf3fc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:43.065318 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-baef1c19-ac73-4ed7-a2ca-19deebbf3fc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:43.065851 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-baef1c19-ac73-4ed7-a2ca-19deebbf3fc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:43.066831 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-baef1c19-ac73-4ed7-a2ca-19deebbf3fc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:43.067488 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-baef1c19-ac73-4ed7-a2ca-19deebbf3fc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:43.094503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e80b9105-467c-4622-b6b3-ddf990029444 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:43.095231 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e80b9105-467c-4622-b6b3-ddf990029444 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:43.102289 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e80b9105-467c-4622-b6b3-ddf990029444 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:43.102830 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e80b9105-467c-4622-b6b3-ddf990029444 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:43.103828 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e80b9105-467c-4622-b6b3-ddf990029444 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:43.104514 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e80b9105-467c-4622-b6b3-ddf990029444 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:43.154346 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-baef1c19-ac73-4ed7-a2ca-19deebbf3fc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:43.162833 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-baef1c19-ac73-4ed7-a2ca-19deebbf3fc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1273 microversion: 2.1 time: 0.108048 Nov 11 20:38:43.163943 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 39/73] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:43 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:43.266796 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e80b9105-467c-4622-b6b3-ddf990029444 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:43.288340 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e80b9105-467c-4622-b6b3-ddf990029444 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.187477 Nov 11 20:38:43.289002 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 35/74] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:43 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:43.322735 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d684c087-b3cd-4d82-9637-a480ab8efaa4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:43.323741 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d684c087-b3cd-4d82-9637-a480ab8efaa4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:43.331193 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d684c087-b3cd-4d82-9637-a480ab8efaa4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:43.331193 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d684c087-b3cd-4d82-9637-a480ab8efaa4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:43.331817 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d684c087-b3cd-4d82-9637-a480ab8efaa4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:43.333957 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d684c087-b3cd-4d82-9637-a480ab8efaa4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:43.365461 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3a22e898-14fc-4ad9-be23-882e7b9079f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:43.366095 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3a22e898-14fc-4ad9-be23-882e7b9079f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:43.373419 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3a22e898-14fc-4ad9-be23-882e7b9079f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:43.373886 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3a22e898-14fc-4ad9-be23-882e7b9079f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:43.374713 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3a22e898-14fc-4ad9-be23-882e7b9079f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:43.385707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3a22e898-14fc-4ad9-be23-882e7b9079f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:43.490303 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3a22e898-14fc-4ad9-be23-882e7b9079f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:43.498662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3a22e898-14fc-4ad9-be23-882e7b9079f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:43.500275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3a22e898-14fc-4ad9-be23-882e7b9079f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:43.501350 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3a22e898-14fc-4ad9-be23-882e7b9079f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.157627 Nov 11 20:38:43.501900 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 36/75] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:43 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:38:43.580067 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d684c087-b3cd-4d82-9637-a480ab8efaa4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:43.587601 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d684c087-b3cd-4d82-9637-a480ab8efaa4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.268434 Nov 11 20:38:43.588197 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 40/76] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:43 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:44.179607 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fc7a8d32-cfc6-4960-9aa4-4ae2f777afec tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:44.180256 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fc7a8d32-cfc6-4960-9aa4-4ae2f777afec tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:44.185806 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fc7a8d32-cfc6-4960-9aa4-4ae2f777afec tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:44.186248 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fc7a8d32-cfc6-4960-9aa4-4ae2f777afec tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:44.187003 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fc7a8d32-cfc6-4960-9aa4-4ae2f777afec tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:44.187426 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fc7a8d32-cfc6-4960-9aa4-4ae2f777afec tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:44.245540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-fc7a8d32-cfc6-4960-9aa4-4ae2f777afec tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:44.252697 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fc7a8d32-cfc6-4960-9aa4-4ae2f777afec tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1273 microversion: 2.1 time: 0.076777 Nov 11 20:38:44.253186 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 37/77] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:44 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1273 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:44.305591 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9808378c-691d-4f2a-849b-4ef4662484c8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:44.306212 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9808378c-691d-4f2a-849b-4ef4662484c8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:44.313539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9808378c-691d-4f2a-849b-4ef4662484c8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:44.314143 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9808378c-691d-4f2a-849b-4ef4662484c8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:44.315042 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9808378c-691d-4f2a-849b-4ef4662484c8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:44.315565 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9808378c-691d-4f2a-849b-4ef4662484c8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:44.521240 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-262b5197-225b-47ae-a61a-1c1e798f2460 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:44.522273 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-262b5197-225b-47ae-a61a-1c1e798f2460 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:44.528658 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-262b5197-225b-47ae-a61a-1c1e798f2460 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:44.529241 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-262b5197-225b-47ae-a61a-1c1e798f2460 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:44.529887 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-262b5197-225b-47ae-a61a-1c1e798f2460 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:44.530792 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-262b5197-225b-47ae-a61a-1c1e798f2460 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:44.549577 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9808378c-691d-4f2a-849b-4ef4662484c8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:44.557941 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9808378c-691d-4f2a-849b-4ef4662484c8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.255929 Nov 11 20:38:44.558803 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 41/78] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:44 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:44.606085 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-222ccefc-0431-4443-9229-89fee0f69bc2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:44.606826 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-222ccefc-0431-4443-9229-89fee0f69bc2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:44.612839 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-262b5197-225b-47ae-a61a-1c1e798f2460 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:44.617318 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-222ccefc-0431-4443-9229-89fee0f69bc2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:44.618407 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-222ccefc-0431-4443-9229-89fee0f69bc2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:44.620079 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-222ccefc-0431-4443-9229-89fee0f69bc2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:44.620747 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-222ccefc-0431-4443-9229-89fee0f69bc2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:44.625288 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-262b5197-225b-47ae-a61a-1c1e798f2460 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:44.626985 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-262b5197-225b-47ae-a61a-1c1e798f2460 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:44.633679 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-262b5197-225b-47ae-a61a-1c1e798f2460 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1277 microversion: 2.20 time: 0.111914 Nov 11 20:38:44.640033 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 38/79] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:44 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:38:45.270976 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-37f913a0-d915-4e68-ab1d-df1ebf991a18 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:45.272014 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-37f913a0-d915-4e68-ab1d-df1ebf991a18 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:45.283809 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-37f913a0-d915-4e68-ab1d-df1ebf991a18 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:45.285144 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-37f913a0-d915-4e68-ab1d-df1ebf991a18 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:45.288275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-37f913a0-d915-4e68-ab1d-df1ebf991a18 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:45.289154 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-37f913a0-d915-4e68-ab1d-df1ebf991a18 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:45.310307 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-222ccefc-0431-4443-9229-89fee0f69bc2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:45.318320 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-222ccefc-0431-4443-9229-89fee0f69bc2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.717052 Nov 11 20:38:45.323381 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 42/80] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:44 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:45.567661 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-37f913a0-d915-4e68-ab1d-df1ebf991a18 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:45.574582 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8697734b-fc04-4536-be3b-302ac76d9ad5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:45.575190 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8697734b-fc04-4536-be3b-302ac76d9ad5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:45.579872 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-37f913a0-d915-4e68-ab1d-df1ebf991a18 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1279 microversion: 2.1 time: 0.313591 Nov 11 20:38:45.581586 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 39/81] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:45 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1279 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:45.586952 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8697734b-fc04-4536-be3b-302ac76d9ad5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:45.587406 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8697734b-fc04-4536-be3b-302ac76d9ad5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:45.588233 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8697734b-fc04-4536-be3b-302ac76d9ad5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:45.588668 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8697734b-fc04-4536-be3b-302ac76d9ad5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:45.652153 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-86fa7302-af9d-4ec6-9e57-368e7335a700 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:45.652844 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-86fa7302-af9d-4ec6-9e57-368e7335a700 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:45.662011 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-86fa7302-af9d-4ec6-9e57-368e7335a700 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:45.666674 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-86fa7302-af9d-4ec6-9e57-368e7335a700 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:45.668968 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-86fa7302-af9d-4ec6-9e57-368e7335a700 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:45.669435 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-86fa7302-af9d-4ec6-9e57-368e7335a700 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:45.976746 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-86fa7302-af9d-4ec6-9e57-368e7335a700 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:45.989283 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-86fa7302-af9d-4ec6-9e57-368e7335a700 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:46.013968 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-86fa7302-af9d-4ec6-9e57-368e7335a700 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:46.016897 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-86fa7302-af9d-4ec6-9e57-368e7335a700 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1341 microversion: 2.20 time: 0.368696 Nov 11 20:38:46.020343 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 40/82] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:45 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1341 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:46.225136 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-ae79a89e-4a47-45a3-a989-ec4e3e0bce04 req-2cf18d5f-7ee5-46df-931a-7f1344d7cc0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b182b81-371c-4244-b016-dffa07121ef2", "tag": "90ad1ea9-d70f-404f-aa76-239fd7557f37"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:38:46.229801 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:38:46.229801 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:38:46.242273 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-ae79a89e-4a47-45a3-a989-ec4e3e0bce04 req-2cf18d5f-7ee5-46df-931a-7f1344d7cc0b service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:46.243119 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-ae79a89e-4a47-45a3-a989-ec4e3e0bce04 req-2cf18d5f-7ee5-46df-931a-7f1344d7cc0b service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:46.270076 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-ae79a89e-4a47-45a3-a989-ec4e3e0bce04 req-2cf18d5f-7ee5-46df-931a-7f1344d7cc0b service nova] Creating event network-changed:90ad1ea9-d70f-404f-aa76-239fd7557f37 for instance 4b182b81-371c-4244-b016-dffa07121ef2 on hv-cinder-81764 Nov 11 20:38:46.271690 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-ae79a89e-4a47-45a3-a989-ec4e3e0bce04 req-2cf18d5f-7ee5-46df-931a-7f1344d7cc0b service nova] Acquired lock "compute-rpcapi-router" {{(pid=122527) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 11 20:38:46.274342 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e4f8f6b-7e66-49ae-b9b6-5c301656bd0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:46.275655 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e4f8f6b-7e66-49ae-b9b6-5c301656bd0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:46.276848 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e4f8f6b-7e66-49ae-b9b6-5c301656bd0f None None] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:46.277509 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e4f8f6b-7e66-49ae-b9b6-5c301656bd0f None None] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:46.288777 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8697734b-fc04-4536-be3b-302ac76d9ad5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:46.291237 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.compute.rpcapi [None req-2e4f8f6b-7e66-49ae-b9b6-5c301656bd0f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 11 20:38:46.292946 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e4f8f6b-7e66-49ae-b9b6-5c301656bd0f None None] Releasing lock "compute-rpcapi-router" {{(pid=122527) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 11 20:38:46.304927 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8697734b-fc04-4536-be3b-302ac76d9ad5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.734085 Nov 11 20:38:46.306076 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 43/83] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:45 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:46.336728 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b2637ba9-5b60-441d-9cb0-0612950cab25 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:46.337614 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b2637ba9-5b60-441d-9cb0-0612950cab25 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:46.347744 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b2637ba9-5b60-441d-9cb0-0612950cab25 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:46.349165 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b2637ba9-5b60-441d-9cb0-0612950cab25 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:46.350074 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b2637ba9-5b60-441d-9cb0-0612950cab25 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:46.350520 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b2637ba9-5b60-441d-9cb0-0612950cab25 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:46.357818 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2e4f8f6b-7e66-49ae-b9b6-5c301656bd0f None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265121 Nov 11 20:38:46.359031 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 41/84] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:38:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:38:46.597630 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9521fbed-c8b5-451a-9cbd-8f798915e7a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:46.598466 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9521fbed-c8b5-451a-9cbd-8f798915e7a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:46.615342 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9521fbed-c8b5-451a-9cbd-8f798915e7a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:46.616371 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9521fbed-c8b5-451a-9cbd-8f798915e7a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:46.623465 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9521fbed-c8b5-451a-9cbd-8f798915e7a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:46.624220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9521fbed-c8b5-451a-9cbd-8f798915e7a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:46.875842 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9521fbed-c8b5-451a-9cbd-8f798915e7a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:46.887200 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9521fbed-c8b5-451a-9cbd-8f798915e7a1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1279 microversion: 2.1 time: 0.293450 Nov 11 20:38:46.888644 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 42/85] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:46 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1279 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:47.040963 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b2637ba9-5b60-441d-9cb0-0612950cab25 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:47.045003 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-75bbc401-f4b6-45d4-a3f8-711417646fc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:47.045586 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-75bbc401-f4b6-45d4-a3f8-711417646fc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:47.059349 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b2637ba9-5b60-441d-9cb0-0612950cab25 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.727875 Nov 11 20:38:47.071585 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-75bbc401-f4b6-45d4-a3f8-711417646fc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:47.071888 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 44/86] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:46 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:47.072665 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-75bbc401-f4b6-45d4-a3f8-711417646fc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:47.073717 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-75bbc401-f4b6-45d4-a3f8-711417646fc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:47.074150 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-75bbc401-f4b6-45d4-a3f8-711417646fc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:47.207850 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-75bbc401-f4b6-45d4-a3f8-711417646fc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:47.217945 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-75bbc401-f4b6-45d4-a3f8-711417646fc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:47.219897 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-75bbc401-f4b6-45d4-a3f8-711417646fc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:47.221430 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-75bbc401-f4b6-45d4-a3f8-711417646fc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1339 microversion: 2.20 time: 0.186489 Nov 11 20:38:47.234840 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 43/87] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:47 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1339 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:47.324246 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4cd22331-e58b-4c8e-b542-f21a60c13e5e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:47.324346 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4cd22331-e58b-4c8e-b542-f21a60c13e5e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:47.339909 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4cd22331-e58b-4c8e-b542-f21a60c13e5e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:47.340552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4cd22331-e58b-4c8e-b542-f21a60c13e5e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:47.341144 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4cd22331-e58b-4c8e-b542-f21a60c13e5e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:47.341566 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4cd22331-e58b-4c8e-b542-f21a60c13e5e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:47.437648 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-8c843877-a746-4d9b-b325-3b8933c2a744 req-dbc74207-0c19-4cce-ab72-d51994c16bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2a29b9-345d-48ed-ab58-999c80cd44d8", "tag": "a1e7e113-49ef-49f9-9fd9-7534d076360a"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:38:47.439247 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:38:47.439247 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:38:47.447019 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-8c843877-a746-4d9b-b325-3b8933c2a744 req-dbc74207-0c19-4cce-ab72-d51994c16bf3 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:47.447462 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-8c843877-a746-4d9b-b325-3b8933c2a744 req-dbc74207-0c19-4cce-ab72-d51994c16bf3 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:47.459675 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-8c843877-a746-4d9b-b325-3b8933c2a744 req-dbc74207-0c19-4cce-ab72-d51994c16bf3 service nova] Creating event network-changed:a1e7e113-49ef-49f9-9fd9-7534d076360a for instance aa2a29b9-345d-48ed-ab58-999c80cd44d8 on hv-cinder-81764 Nov 11 20:38:47.465063 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-8c843877-a746-4d9b-b325-3b8933c2a744 req-dbc74207-0c19-4cce-ab72-d51994c16bf3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090062 Nov 11 20:38:47.465857 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 44/88] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:38:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:38:47.709979 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4cd22331-e58b-4c8e-b542-f21a60c13e5e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:47.718454 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4cd22331-e58b-4c8e-b542-f21a60c13e5e tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.399869 Nov 11 20:38:47.719314 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 45/89] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:47 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:47.905065 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b0b54018-b2cb-4926-93a5-1aff784e6254 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:47.905747 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b0b54018-b2cb-4926-93a5-1aff784e6254 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:47.913860 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b0b54018-b2cb-4926-93a5-1aff784e6254 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:47.914591 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b0b54018-b2cb-4926-93a5-1aff784e6254 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:47.915777 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b0b54018-b2cb-4926-93a5-1aff784e6254 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:47.916475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b0b54018-b2cb-4926-93a5-1aff784e6254 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:48.080443 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5630dea6-56ef-4bd0-bc22-fe7ad72bfe5a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:48.084518 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5630dea6-56ef-4bd0-bc22-fe7ad72bfe5a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:48.100181 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5630dea6-56ef-4bd0-bc22-fe7ad72bfe5a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:48.100621 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5630dea6-56ef-4bd0-bc22-fe7ad72bfe5a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:48.101405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5630dea6-56ef-4bd0-bc22-fe7ad72bfe5a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:48.101832 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5630dea6-56ef-4bd0-bc22-fe7ad72bfe5a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:48.356199 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b0b54018-b2cb-4926-93a5-1aff784e6254 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:48.364587 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b0b54018-b2cb-4926-93a5-1aff784e6254 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.463008 Nov 11 20:38:48.365189 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 45/90] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:47 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:48.369998 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-df5887de-6d2c-425c-9932-e93c7b86a23b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:48.370597 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-df5887de-6d2c-425c-9932-e93c7b86a23b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:48.377393 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-df5887de-6d2c-425c-9932-e93c7b86a23b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:48.382436 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5630dea6-56ef-4bd0-bc22-fe7ad72bfe5a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:48.384735 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-df5887de-6d2c-425c-9932-e93c7b86a23b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:48.386022 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-df5887de-6d2c-425c-9932-e93c7b86a23b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:48.386629 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-df5887de-6d2c-425c-9932-e93c7b86a23b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:48.389901 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5630dea6-56ef-4bd0-bc22-fe7ad72bfe5a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.316990 Nov 11 20:38:48.390663 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 46/91] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:48 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:48.398332 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-4f228cb0-0fa6-46a2-b8ad-5ed2a8ba504e req-1d8f12fc-7489-4c97-b162-e5cd4786b5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e9bc60a-d6ec-4b5a-a39f-5430afa0b859", "tag": "767cb3d9-cf56-4615-8623-4ec857595582"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:38:48.401178 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:38:48.401178 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:38:48.412332 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-4f228cb0-0fa6-46a2-b8ad-5ed2a8ba504e req-1d8f12fc-7489-4c97-b162-e5cd4786b5a9 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:48.412773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-4f228cb0-0fa6-46a2-b8ad-5ed2a8ba504e req-1d8f12fc-7489-4c97-b162-e5cd4786b5a9 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:48.434426 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-4f228cb0-0fa6-46a2-b8ad-5ed2a8ba504e req-1d8f12fc-7489-4c97-b162-e5cd4786b5a9 service nova] Creating event network-changed:767cb3d9-cf56-4615-8623-4ec857595582 for instance 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 on hv-cinder-81764 Nov 11 20:38:48.434960 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-4f228cb0-0fa6-46a2-b8ad-5ed2a8ba504e req-1d8f12fc-7489-4c97-b162-e5cd4786b5a9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122526) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 11 20:38:48.436133 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3269f85-d571-407f-9538-df993f065344 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:48.436569 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3269f85-d571-407f-9538-df993f065344 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:48.437350 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3269f85-d571-407f-9538-df993f065344 None None] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:48.437772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3269f85-d571-407f-9538-df993f065344 None None] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:48.449332 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.compute.rpcapi [None req-e3269f85-d571-407f-9538-df993f065344 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 11 20:38:48.450427 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3269f85-d571-407f-9538-df993f065344 None None] Releasing lock "compute-rpcapi-router" {{(pid=122526) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 11 20:38:48.475507 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e3269f85-d571-407f-9538-df993f065344 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083463 Nov 11 20:38:48.476124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 47/92] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:38:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:38:48.528096 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-df5887de-6d2c-425c-9932-e93c7b86a23b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:48.538848 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-df5887de-6d2c-425c-9932-e93c7b86a23b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:48.540466 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-df5887de-6d2c-425c-9932-e93c7b86a23b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:48.541568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-df5887de-6d2c-425c-9932-e93c7b86a23b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.175208 Nov 11 20:38:48.542114 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 46/93] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:48 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:48.737786 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-36581901-14f2-4c01-ac24-39d5ad0c9705 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:48.738904 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-36581901-14f2-4c01-ac24-39d5ad0c9705 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:48.744949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-36581901-14f2-4c01-ac24-39d5ad0c9705 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:48.745395 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-36581901-14f2-4c01-ac24-39d5ad0c9705 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:48.746158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-36581901-14f2-4c01-ac24-39d5ad0c9705 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:48.746585 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-36581901-14f2-4c01-ac24-39d5ad0c9705 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:48.875067 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-36581901-14f2-4c01-ac24-39d5ad0c9705 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:48.883669 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-36581901-14f2-4c01-ac24-39d5ad0c9705 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.149987 Nov 11 20:38:48.884260 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 48/94] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:48 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:49.383178 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0e924319-6d4d-41cf-9488-ad7508c561a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:49.384106 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0e924319-6d4d-41cf-9488-ad7508c561a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:49.390041 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0e924319-6d4d-41cf-9488-ad7508c561a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:49.390562 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0e924319-6d4d-41cf-9488-ad7508c561a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:49.391423 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0e924319-6d4d-41cf-9488-ad7508c561a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:49.391931 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0e924319-6d4d-41cf-9488-ad7508c561a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:49.406800 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-55f464f1-53aa-46ce-a7c1-0d786c842840 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:49.407533 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-55f464f1-53aa-46ce-a7c1-0d786c842840 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:49.414774 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-55f464f1-53aa-46ce-a7c1-0d786c842840 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:49.415336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-55f464f1-53aa-46ce-a7c1-0d786c842840 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:49.416264 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-55f464f1-53aa-46ce-a7c1-0d786c842840 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:49.416803 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-55f464f1-53aa-46ce-a7c1-0d786c842840 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:49.598885 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0e924319-6d4d-41cf-9488-ad7508c561a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:49.608854 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0e924319-6d4d-41cf-9488-ad7508c561a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.230691 Nov 11 20:38:49.609393 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 47/95] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:49 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:49.614102 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-c9e6cbe7-917f-46c0-915f-aefbc94e76ba req-78abb5c1-c2b3-4bfe-8ea8-5259f4186179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd75246-98f4-4479-be99-f39c6427cc92", "tag": "66b27c9f-82a4-466b-830b-548c3a8a129f"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:38:49.616447 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:38:49.616447 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:38:49.623821 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-c9e6cbe7-917f-46c0-915f-aefbc94e76ba req-78abb5c1-c2b3-4bfe-8ea8-5259f4186179 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:49.624292 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-c9e6cbe7-917f-46c0-915f-aefbc94e76ba req-78abb5c1-c2b3-4bfe-8ea8-5259f4186179 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:49.625123 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-55f464f1-53aa-46ce-a7c1-0d786c842840 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:49.636117 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-c9e6cbe7-917f-46c0-915f-aefbc94e76ba req-78abb5c1-c2b3-4bfe-8ea8-5259f4186179 service nova] Creating event network-changed:66b27c9f-82a4-466b-830b-548c3a8a129f for instance ddd75246-98f4-4479-be99-f39c6427cc92 on hv-cinder-81764 Nov 11 20:38:49.638281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-55f464f1-53aa-46ce-a7c1-0d786c842840 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.235240 Nov 11 20:38:49.641243 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-c9e6cbe7-917f-46c0-915f-aefbc94e76ba req-78abb5c1-c2b3-4bfe-8ea8-5259f4186179 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030445 Nov 11 20:38:49.641841 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 48/96] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:38:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:38:49.647580 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b583b58a-b2ee-4218-8de2-7eea9b86f1ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:49.648224 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b583b58a-b2ee-4218-8de2-7eea9b86f1ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:49.651862 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 49/97] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:49 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:49.655068 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b583b58a-b2ee-4218-8de2-7eea9b86f1ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:49.655520 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b583b58a-b2ee-4218-8de2-7eea9b86f1ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:49.656335 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b583b58a-b2ee-4218-8de2-7eea9b86f1ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:49.656764 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b583b58a-b2ee-4218-8de2-7eea9b86f1ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:49.800097 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b583b58a-b2ee-4218-8de2-7eea9b86f1ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:49.808327 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b583b58a-b2ee-4218-8de2-7eea9b86f1ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:49.809823 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b583b58a-b2ee-4218-8de2-7eea9b86f1ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:49.810909 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b583b58a-b2ee-4218-8de2-7eea9b86f1ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.168015 Nov 11 20:38:49.811463 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 49/98] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:49 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:49.900766 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-21ca3799-cd52-49c7-8448-ebf1713381a0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:49.901370 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-21ca3799-cd52-49c7-8448-ebf1713381a0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:49.907073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-21ca3799-cd52-49c7-8448-ebf1713381a0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:49.907513 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-21ca3799-cd52-49c7-8448-ebf1713381a0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:49.908598 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-21ca3799-cd52-49c7-8448-ebf1713381a0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:49.909029 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-21ca3799-cd52-49c7-8448-ebf1713381a0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:50.041356 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-21ca3799-cd52-49c7-8448-ebf1713381a0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:50.048513 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-21ca3799-cd52-49c7-8448-ebf1713381a0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.151375 Nov 11 20:38:50.049014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 50/99] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:49 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:50.636425 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-be8ffa4a-ade9-4dfc-8270-51aeab98f8c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:50.637013 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-be8ffa4a-ade9-4dfc-8270-51aeab98f8c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:50.643944 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be8ffa4a-ade9-4dfc-8270-51aeab98f8c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:50.644420 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be8ffa4a-ade9-4dfc-8270-51aeab98f8c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:50.645207 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be8ffa4a-ade9-4dfc-8270-51aeab98f8c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:50.645645 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be8ffa4a-ade9-4dfc-8270-51aeab98f8c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:50.661892 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c1b3d30c-cdf2-491a-b091-c71776ecfc0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:50.663785 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c1b3d30c-cdf2-491a-b091-c71776ecfc0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:50.675267 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c1b3d30c-cdf2-491a-b091-c71776ecfc0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:50.676880 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c1b3d30c-cdf2-491a-b091-c71776ecfc0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:50.677920 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c1b3d30c-cdf2-491a-b091-c71776ecfc0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:50.678524 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c1b3d30c-cdf2-491a-b091-c71776ecfc0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:51.404431 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c1b3d30c-cdf2-491a-b091-c71776ecfc0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:51.414764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c1b3d30c-cdf2-491a-b091-c71776ecfc0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.759422 Nov 11 20:38:51.416056 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 51/100] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:50 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:51.421521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7f082115-b5dd-4961-a808-7b2073c8efcc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:51.422815 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7f082115-b5dd-4961-a808-7b2073c8efcc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:51.432315 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7f082115-b5dd-4961-a808-7b2073c8efcc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:51.433175 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7f082115-b5dd-4961-a808-7b2073c8efcc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:51.434608 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7f082115-b5dd-4961-a808-7b2073c8efcc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:51.437729 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7f082115-b5dd-4961-a808-7b2073c8efcc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:51.438073 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-be8ffa4a-ade9-4dfc-8270-51aeab98f8c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:51.448759 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-be8ffa4a-ade9-4dfc-8270-51aeab98f8c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.815409 Nov 11 20:38:51.450044 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 50/101] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:50 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:51.454937 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b5f1adcb-4e90-43cc-a138-bc61dac86957 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:51.455770 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b5f1adcb-4e90-43cc-a138-bc61dac86957 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:51.464810 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b5f1adcb-4e90-43cc-a138-bc61dac86957 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:51.465610 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b5f1adcb-4e90-43cc-a138-bc61dac86957 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:51.467124 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b5f1adcb-4e90-43cc-a138-bc61dac86957 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:51.468035 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b5f1adcb-4e90-43cc-a138-bc61dac86957 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:52.322287 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b5f1adcb-4e90-43cc-a138-bc61dac86957 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:52.325109 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7f082115-b5dd-4961-a808-7b2073c8efcc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:52.341554 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7f082115-b5dd-4961-a808-7b2073c8efcc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:52.341759 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7f082115-b5dd-4961-a808-7b2073c8efcc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:52.348609 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7f082115-b5dd-4961-a808-7b2073c8efcc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.930594 Nov 11 20:38:52.349743 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 52/102] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:51 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:52.363926 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b5f1adcb-4e90-43cc-a138-bc61dac86957 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.912532 Nov 11 20:38:52.373469 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 51/103] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:51 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:52.433820 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5fa8b042-ea79-4e69-8455-c9f5325a79a4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:52.434638 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5fa8b042-ea79-4e69-8455-c9f5325a79a4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:52.440967 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5fa8b042-ea79-4e69-8455-c9f5325a79a4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:52.443387 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5fa8b042-ea79-4e69-8455-c9f5325a79a4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:52.446534 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5fa8b042-ea79-4e69-8455-c9f5325a79a4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:52.446962 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5fa8b042-ea79-4e69-8455-c9f5325a79a4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:52.465970 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7bd26e67-dbb5-4d54-be22-fc244f60ce71 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:52.466587 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7bd26e67-dbb5-4d54-be22-fc244f60ce71 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:52.475116 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7bd26e67-dbb5-4d54-be22-fc244f60ce71 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:52.475571 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7bd26e67-dbb5-4d54-be22-fc244f60ce71 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:52.476403 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7bd26e67-dbb5-4d54-be22-fc244f60ce71 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:52.476844 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7bd26e67-dbb5-4d54-be22-fc244f60ce71 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:53.046546 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7bd26e67-dbb5-4d54-be22-fc244f60ce71 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:53.051592 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5fa8b042-ea79-4e69-8455-c9f5325a79a4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:53.071550 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7bd26e67-dbb5-4d54-be22-fc244f60ce71 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.609135 Nov 11 20:38:53.071763 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5fa8b042-ea79-4e69-8455-c9f5325a79a4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.639710 Nov 11 20:38:53.076369 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 52/104] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:52 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:53.089452 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-48ca9e2e-b5ec-4fc6-9b93-a8e2f18bd15a req-6ef062ab-4bf9-40a4-a48e-b14edccaebc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce4a9f51-80d0-4901-beaf-9b03435f002c", "tag": "bc0e19f0-bdca-4923-a0c3-77ad0c202bdc"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:38:53.091203 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 53/105] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:52 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:53.100913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:38:53.100913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:38:53.118263 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-48ca9e2e-b5ec-4fc6-9b93-a8e2f18bd15a req-6ef062ab-4bf9-40a4-a48e-b14edccaebc9 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:53.118706 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-48ca9e2e-b5ec-4fc6-9b93-a8e2f18bd15a req-6ef062ab-4bf9-40a4-a48e-b14edccaebc9 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:53.147141 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-48ca9e2e-b5ec-4fc6-9b93-a8e2f18bd15a req-6ef062ab-4bf9-40a4-a48e-b14edccaebc9 service nova] Creating event network-changed:bc0e19f0-bdca-4923-a0c3-77ad0c202bdc for instance ce4a9f51-80d0-4901-beaf-9b03435f002c on hv-cinder-81764 Nov 11 20:38:53.152760 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-48ca9e2e-b5ec-4fc6-9b93-a8e2f18bd15a req-6ef062ab-4bf9-40a4-a48e-b14edccaebc9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072883 Nov 11 20:38:53.153561 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 53/106] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:38:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:38:53.368843 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-69a20faa-2aec-45dd-9e6f-1cb08bfebab6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:53.369705 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-69a20faa-2aec-45dd-9e6f-1cb08bfebab6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:53.376220 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-69a20faa-2aec-45dd-9e6f-1cb08bfebab6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:53.377069 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-69a20faa-2aec-45dd-9e6f-1cb08bfebab6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:53.377860 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-69a20faa-2aec-45dd-9e6f-1cb08bfebab6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:53.378451 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-69a20faa-2aec-45dd-9e6f-1cb08bfebab6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:53.382677 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-df20275c-7d50-4d0d-bad5-5b7a42dda5e5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:53.383462 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-df20275c-7d50-4d0d-bad5-5b7a42dda5e5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:53.389867 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-df20275c-7d50-4d0d-bad5-5b7a42dda5e5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:53.390345 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-df20275c-7d50-4d0d-bad5-5b7a42dda5e5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:53.391141 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-df20275c-7d50-4d0d-bad5-5b7a42dda5e5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:53.391573 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-df20275c-7d50-4d0d-bad5-5b7a42dda5e5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:53.745265 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-69a20faa-2aec-45dd-9e6f-1cb08bfebab6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:53.753278 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-69a20faa-2aec-45dd-9e6f-1cb08bfebab6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:53.755575 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-69a20faa-2aec-45dd-9e6f-1cb08bfebab6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:53.756713 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-69a20faa-2aec-45dd-9e6f-1cb08bfebab6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.392691 Nov 11 20:38:53.757451 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 54/107] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:53 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:53.762289 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-df20275c-7d50-4d0d-bad5-5b7a42dda5e5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:53.774163 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-df20275c-7d50-4d0d-bad5-5b7a42dda5e5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.395890 Nov 11 20:38:53.784415 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 54/108] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:53 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:54.093979 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fb06ca0e-12d5-41da-94ef-1adc1003d7f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:54.094580 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fb06ca0e-12d5-41da-94ef-1adc1003d7f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:54.102649 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fb06ca0e-12d5-41da-94ef-1adc1003d7f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:54.103069 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fb06ca0e-12d5-41da-94ef-1adc1003d7f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:54.104219 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fb06ca0e-12d5-41da-94ef-1adc1003d7f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:54.104715 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fb06ca0e-12d5-41da-94ef-1adc1003d7f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:54.107469 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c7eecb8d-5bd6-4bf4-b9f9-3e61ea6777a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:54.108287 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c7eecb8d-5bd6-4bf4-b9f9-3e61ea6777a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:54.114983 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c7eecb8d-5bd6-4bf4-b9f9-3e61ea6777a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:54.115667 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c7eecb8d-5bd6-4bf4-b9f9-3e61ea6777a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:54.116686 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c7eecb8d-5bd6-4bf4-b9f9-3e61ea6777a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:54.117114 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c7eecb8d-5bd6-4bf4-b9f9-3e61ea6777a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:54.569525 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fb06ca0e-12d5-41da-94ef-1adc1003d7f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:54.577378 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fb06ca0e-12d5-41da-94ef-1adc1003d7f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.486884 Nov 11 20:38:54.587688 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 55/109] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:54 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:54.606428 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c7eecb8d-5bd6-4bf4-b9f9-3e61ea6777a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:54.615532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c7eecb8d-5bd6-4bf4-b9f9-3e61ea6777a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.511713 Nov 11 20:38:54.616405 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 55/110] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:54 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:54.774865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6faf87a4-d25f-4eb7-9aa1-3aad6126c656 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:54.776073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6faf87a4-d25f-4eb7-9aa1-3aad6126c656 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:54.781751 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6faf87a4-d25f-4eb7-9aa1-3aad6126c656 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:54.782203 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6faf87a4-d25f-4eb7-9aa1-3aad6126c656 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:54.782991 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6faf87a4-d25f-4eb7-9aa1-3aad6126c656 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:54.783426 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6faf87a4-d25f-4eb7-9aa1-3aad6126c656 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:54.791077 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7f5851b3-b38a-43f7-b77c-752d6f17e0f8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:54.791908 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7f5851b3-b38a-43f7-b77c-752d6f17e0f8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:54.797987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7f5851b3-b38a-43f7-b77c-752d6f17e0f8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:54.798512 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7f5851b3-b38a-43f7-b77c-752d6f17e0f8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:54.799517 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7f5851b3-b38a-43f7-b77c-752d6f17e0f8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:54.800177 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7f5851b3-b38a-43f7-b77c-752d6f17e0f8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:55.028331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6faf87a4-d25f-4eb7-9aa1-3aad6126c656 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:55.033067 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7f5851b3-b38a-43f7-b77c-752d6f17e0f8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:55.039028 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6faf87a4-d25f-4eb7-9aa1-3aad6126c656 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:55.040762 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7f5851b3-b38a-43f7-b77c-752d6f17e0f8 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.253281 Nov 11 20:38:55.041256 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6faf87a4-d25f-4eb7-9aa1-3aad6126c656 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:55.041690 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 56/111] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:54 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:55.042975 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6faf87a4-d25f-4eb7-9aa1-3aad6126c656 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.271735 Nov 11 20:38:55.043527 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 56/112] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:54 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:55.594334 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ea6a4474-7f6a-4b55-944a-f2ce554ede7a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:55.594928 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ea6a4474-7f6a-4b55-944a-f2ce554ede7a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:55.600884 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ea6a4474-7f6a-4b55-944a-f2ce554ede7a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:55.601553 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ea6a4474-7f6a-4b55-944a-f2ce554ede7a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:55.602376 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ea6a4474-7f6a-4b55-944a-f2ce554ede7a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:55.602811 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ea6a4474-7f6a-4b55-944a-f2ce554ede7a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:55.632893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e68d6b50-ba9c-400f-b069-567ddfbee78f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:55.633495 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e68d6b50-ba9c-400f-b069-567ddfbee78f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:55.639787 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e68d6b50-ba9c-400f-b069-567ddfbee78f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:55.640605 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e68d6b50-ba9c-400f-b069-567ddfbee78f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:55.641531 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e68d6b50-ba9c-400f-b069-567ddfbee78f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:55.642115 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e68d6b50-ba9c-400f-b069-567ddfbee78f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:55.811447 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ea6a4474-7f6a-4b55-944a-f2ce554ede7a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:55.819660 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ea6a4474-7f6a-4b55-944a-f2ce554ede7a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.228970 Nov 11 20:38:55.820611 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 57/113] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:55 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:55.926621 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e68d6b50-ba9c-400f-b069-567ddfbee78f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:55.943287 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e68d6b50-ba9c-400f-b069-567ddfbee78f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.314499 Nov 11 20:38:55.945110 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 57/114] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:55 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:56.061611 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c3f39d79-848f-4c1a-a8ba-378bd3da3b45 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:56.062215 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c3f39d79-848f-4c1a-a8ba-378bd3da3b45 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:56.067400 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a813be66-bb4c-4564-88f1-c5ded0354e0c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:56.069053 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a813be66-bb4c-4564-88f1-c5ded0354e0c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:56.077874 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c3f39d79-848f-4c1a-a8ba-378bd3da3b45 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:56.081828 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a813be66-bb4c-4564-88f1-c5ded0354e0c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:56.085084 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c3f39d79-848f-4c1a-a8ba-378bd3da3b45 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:56.086139 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c3f39d79-848f-4c1a-a8ba-378bd3da3b45 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:56.086814 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a813be66-bb4c-4564-88f1-c5ded0354e0c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:56.087780 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a813be66-bb4c-4564-88f1-c5ded0354e0c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:56.088416 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c3f39d79-848f-4c1a-a8ba-378bd3da3b45 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:56.094115 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a813be66-bb4c-4564-88f1-c5ded0354e0c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:56.563455 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a813be66-bb4c-4564-88f1-c5ded0354e0c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:56.568191 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c3f39d79-848f-4c1a-a8ba-378bd3da3b45 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:56.579094 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c3f39d79-848f-4c1a-a8ba-378bd3da3b45 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:56.581744 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a813be66-bb4c-4564-88f1-c5ded0354e0c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.525885 Nov 11 20:38:56.582779 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c3f39d79-848f-4c1a-a8ba-378bd3da3b45 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:56.584264 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c3f39d79-848f-4c1a-a8ba-378bd3da3b45 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.526963 Nov 11 20:38:56.593047 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 58/115] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:56 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:56.595082 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 58/116] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:56 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:56.837850 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b2569cb2-bc1d-4065-9040-b01bcf0af9e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:56.838453 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b2569cb2-bc1d-4065-9040-b01bcf0af9e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:56.844394 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2569cb2-bc1d-4065-9040-b01bcf0af9e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:56.844842 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2569cb2-bc1d-4065-9040-b01bcf0af9e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:56.846012 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2569cb2-bc1d-4065-9040-b01bcf0af9e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:56.846546 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2569cb2-bc1d-4065-9040-b01bcf0af9e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:56.961350 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5b44a789-4853-433a-b67b-c07916683af9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:56.961955 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5b44a789-4853-433a-b67b-c07916683af9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:56.967861 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b44a789-4853-433a-b67b-c07916683af9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:56.968334 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b44a789-4853-433a-b67b-c07916683af9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:56.969119 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b44a789-4853-433a-b67b-c07916683af9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:56.969554 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b44a789-4853-433a-b67b-c07916683af9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:56.986735 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b2569cb2-bc1d-4065-9040-b01bcf0af9e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:57.000564 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b2569cb2-bc1d-4065-9040-b01bcf0af9e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.166808 Nov 11 20:38:57.001142 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 59/117] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:56 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:57.109956 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5b44a789-4853-433a-b67b-c07916683af9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:57.117993 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5b44a789-4853-433a-b67b-c07916683af9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.160211 Nov 11 20:38:57.118558 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 59/118] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:56 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:57.598726 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d86dfaf3-ebb0-4e67-90c7-5581c6ca834f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:57.599585 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d86dfaf3-ebb0-4e67-90c7-5581c6ca834f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:57.602425 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7289dce4-1cb2-4f01-8910-3f1a011e006e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:57.603333 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7289dce4-1cb2-4f01-8910-3f1a011e006e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:57.609479 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7289dce4-1cb2-4f01-8910-3f1a011e006e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:57.609900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7289dce4-1cb2-4f01-8910-3f1a011e006e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:57.610558 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7289dce4-1cb2-4f01-8910-3f1a011e006e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:57.610989 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7289dce4-1cb2-4f01-8910-3f1a011e006e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:57.614713 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d86dfaf3-ebb0-4e67-90c7-5581c6ca834f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:57.615425 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d86dfaf3-ebb0-4e67-90c7-5581c6ca834f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:57.616462 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d86dfaf3-ebb0-4e67-90c7-5581c6ca834f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:57.617094 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d86dfaf3-ebb0-4e67-90c7-5581c6ca834f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:57.811919 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7289dce4-1cb2-4f01-8910-3f1a011e006e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:57.820627 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7289dce4-1cb2-4f01-8910-3f1a011e006e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:57.820775 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d86dfaf3-ebb0-4e67-90c7-5581c6ca834f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:57.822247 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7289dce4-1cb2-4f01-8910-3f1a011e006e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:57.823662 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7289dce4-1cb2-4f01-8910-3f1a011e006e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.225447 Nov 11 20:38:57.824442 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 60/119] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:57 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:38:57.839573 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d86dfaf3-ebb0-4e67-90c7-5581c6ca834f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.244421 Nov 11 20:38:57.840303 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 60/120] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:57 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:58.017488 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f49ad3cf-0d87-4c97-864b-76b609552232 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:58.018098 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f49ad3cf-0d87-4c97-864b-76b609552232 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:58.024958 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f49ad3cf-0d87-4c97-864b-76b609552232 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:58.025568 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f49ad3cf-0d87-4c97-864b-76b609552232 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:58.026572 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f49ad3cf-0d87-4c97-864b-76b609552232 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:58.027085 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f49ad3cf-0d87-4c97-864b-76b609552232 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:58.135329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-81a71581-83e9-4a5d-81ae-202be5a06029 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:58.135929 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-81a71581-83e9-4a5d-81ae-202be5a06029 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:58.143646 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-81a71581-83e9-4a5d-81ae-202be5a06029 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:58.144347 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-81a71581-83e9-4a5d-81ae-202be5a06029 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:58.145684 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-81a71581-83e9-4a5d-81ae-202be5a06029 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:58.146329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-81a71581-83e9-4a5d-81ae-202be5a06029 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:58.206786 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f49ad3cf-0d87-4c97-864b-76b609552232 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:58.216463 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f49ad3cf-0d87-4c97-864b-76b609552232 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.202533 Nov 11 20:38:58.217845 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 61/121] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:58 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:58.312412 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-81a71581-83e9-4a5d-81ae-202be5a06029 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:58.320149 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-81a71581-83e9-4a5d-81ae-202be5a06029 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.188569 Nov 11 20:38:58.320724 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 61/122] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:58 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:58.842541 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d27562c8-d0b6-40c0-aad1-697e5e7d2b28 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:58.843022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d27562c8-d0b6-40c0-aad1-697e5e7d2b28 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:58.849371 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d27562c8-d0b6-40c0-aad1-697e5e7d2b28 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:58.850007 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d27562c8-d0b6-40c0-aad1-697e5e7d2b28 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:58.851062 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d27562c8-d0b6-40c0-aad1-697e5e7d2b28 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:58.851522 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d27562c8-d0b6-40c0-aad1-697e5e7d2b28 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:58.855268 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-11764098-3334-4a90-8f70-e9aa2a5d4fc0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:58.856590 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-11764098-3334-4a90-8f70-e9aa2a5d4fc0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:58.862427 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-11764098-3334-4a90-8f70-e9aa2a5d4fc0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:58.862858 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-11764098-3334-4a90-8f70-e9aa2a5d4fc0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:58.863860 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-11764098-3334-4a90-8f70-e9aa2a5d4fc0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:58.864305 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-11764098-3334-4a90-8f70-e9aa2a5d4fc0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:59.087870 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d27562c8-d0b6-40c0-aad1-697e5e7d2b28 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:59.089269 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-11764098-3334-4a90-8f70-e9aa2a5d4fc0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:59.096666 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d27562c8-d0b6-40c0-aad1-697e5e7d2b28 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:59.097998 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-11764098-3334-4a90-8f70-e9aa2a5d4fc0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.246131 Nov 11 20:38:59.098252 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d27562c8-d0b6-40c0-aad1-697e5e7d2b28 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:59.101971 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 62/123] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:58 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:38:59.103717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d27562c8-d0b6-40c0-aad1-697e5e7d2b28 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.264923 Nov 11 20:38:59.104318 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 62/124] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:38:58 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:38:59.235128 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5fbd48eb-c45a-4faa-9926-7e6eede5ac88 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:59.236232 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5fbd48eb-c45a-4faa-9926-7e6eede5ac88 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:59.242862 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5fbd48eb-c45a-4faa-9926-7e6eede5ac88 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:59.243717 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5fbd48eb-c45a-4faa-9926-7e6eede5ac88 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:59.244979 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5fbd48eb-c45a-4faa-9926-7e6eede5ac88 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:59.245567 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5fbd48eb-c45a-4faa-9926-7e6eede5ac88 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:59.336233 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-691f07a3-1a6c-4d30-aefb-aa2775532c0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:38:59.336995 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-691f07a3-1a6c-4d30-aefb-aa2775532c0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:38:59.343132 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-691f07a3-1a6c-4d30-aefb-aa2775532c0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:59.343813 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-691f07a3-1a6c-4d30-aefb-aa2775532c0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:59.344621 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-691f07a3-1a6c-4d30-aefb-aa2775532c0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:38:59.345053 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-691f07a3-1a6c-4d30-aefb-aa2775532c0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:38:59.431668 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5fbd48eb-c45a-4faa-9926-7e6eede5ac88 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:59.439552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5fbd48eb-c45a-4faa-9926-7e6eede5ac88 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.208550 Nov 11 20:38:59.440370 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 63/125] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:59 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:38:59.500920 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-691f07a3-1a6c-4d30-aefb-aa2775532c0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:38:59.508502 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-691f07a3-1a6c-4d30-aefb-aa2775532c0b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.176061 Nov 11 20:38:59.509155 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 63/126] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:38:59 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:00.116509 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-250a10c6-22ed-4818-ad4e-27f5bedadc0d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:00.117313 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-250a10c6-22ed-4818-ad4e-27f5bedadc0d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:00.122681 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5b7f0466-41ab-4096-b58d-784b4d14fa1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:00.123893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5b7f0466-41ab-4096-b58d-784b4d14fa1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:00.124054 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-250a10c6-22ed-4818-ad4e-27f5bedadc0d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:00.124398 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-250a10c6-22ed-4818-ad4e-27f5bedadc0d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:00.125173 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-250a10c6-22ed-4818-ad4e-27f5bedadc0d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:00.125602 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-250a10c6-22ed-4818-ad4e-27f5bedadc0d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:00.130275 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b7f0466-41ab-4096-b58d-784b4d14fa1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:00.130708 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b7f0466-41ab-4096-b58d-784b4d14fa1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:00.131782 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b7f0466-41ab-4096-b58d-784b4d14fa1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:00.132355 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b7f0466-41ab-4096-b58d-784b4d14fa1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:00.338291 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-250a10c6-22ed-4818-ad4e-27f5bedadc0d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:00.345259 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-250a10c6-22ed-4818-ad4e-27f5bedadc0d tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.232558 Nov 11 20:39:00.345823 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 64/127] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:00 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:00.355200 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5b7f0466-41ab-4096-b58d-784b4d14fa1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:00.360494 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5b7f0466-41ab-4096-b58d-784b4d14fa1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:00.361986 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5b7f0466-41ab-4096-b58d-784b4d14fa1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:00.363077 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5b7f0466-41ab-4096-b58d-784b4d14fa1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.244644 Nov 11 20:39:00.364362 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 64/128] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:00 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:39:00.458207 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9d57d7ce-fec3-4692-bd73-da48bcdd2896 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:00.458911 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9d57d7ce-fec3-4692-bd73-da48bcdd2896 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:00.465772 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9d57d7ce-fec3-4692-bd73-da48bcdd2896 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:00.466192 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9d57d7ce-fec3-4692-bd73-da48bcdd2896 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:00.466973 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9d57d7ce-fec3-4692-bd73-da48bcdd2896 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:00.467501 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9d57d7ce-fec3-4692-bd73-da48bcdd2896 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:00.526188 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-551dffb1-1ee8-4b80-b5e9-fadfe72b7ce2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:00.526792 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-551dffb1-1ee8-4b80-b5e9-fadfe72b7ce2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:00.532764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-551dffb1-1ee8-4b80-b5e9-fadfe72b7ce2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:00.533191 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-551dffb1-1ee8-4b80-b5e9-fadfe72b7ce2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:00.534022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-551dffb1-1ee8-4b80-b5e9-fadfe72b7ce2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:00.534459 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-551dffb1-1ee8-4b80-b5e9-fadfe72b7ce2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:00.668325 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9d57d7ce-fec3-4692-bd73-da48bcdd2896 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:00.679544 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9d57d7ce-fec3-4692-bd73-da48bcdd2896 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.224134 Nov 11 20:39:00.682065 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 65/129] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:00 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:00.798649 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-551dffb1-1ee8-4b80-b5e9-fadfe72b7ce2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:00.809044 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-551dffb1-1ee8-4b80-b5e9-fadfe72b7ce2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.286434 Nov 11 20:39:00.821409 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 65/130] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:00 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:01.373220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ce3ddfaa-bd44-42b4-993e-d41816a554fb tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:01.373893 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ce3ddfaa-bd44-42b4-993e-d41816a554fb tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:01.382220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce3ddfaa-bd44-42b4-993e-d41816a554fb tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:01.382723 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0e0d420d-e6af-45b0-8d1a-e8cb6b9571f9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:01.383398 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0e0d420d-e6af-45b0-8d1a-e8cb6b9571f9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:01.383815 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce3ddfaa-bd44-42b4-993e-d41816a554fb tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:01.384995 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce3ddfaa-bd44-42b4-993e-d41816a554fb tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:01.385638 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce3ddfaa-bd44-42b4-993e-d41816a554fb tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:01.398964 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0e0d420d-e6af-45b0-8d1a-e8cb6b9571f9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:01.402270 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0e0d420d-e6af-45b0-8d1a-e8cb6b9571f9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:01.405781 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0e0d420d-e6af-45b0-8d1a-e8cb6b9571f9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:01.407809 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0e0d420d-e6af-45b0-8d1a-e8cb6b9571f9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:01.756697 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ce3ddfaa-bd44-42b4-993e-d41816a554fb tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:01.766953 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0e0d420d-e6af-45b0-8d1a-e8cb6b9571f9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:01.767474 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ce3ddfaa-bd44-42b4-993e-d41816a554fb tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.407783 Nov 11 20:39:01.769459 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 66/131] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:01 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:01.784250 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0e0d420d-e6af-45b0-8d1a-e8cb6b9571f9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:01.786722 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0e0d420d-e6af-45b0-8d1a-e8cb6b9571f9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:01.787741 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-12cb06ec-5b58-4adf-bbed-6b24afeb0e6a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:01.789405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0e0d420d-e6af-45b0-8d1a-e8cb6b9571f9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.411078 Nov 11 20:39:01.789627 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-12cb06ec-5b58-4adf-bbed-6b24afeb0e6a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:01.790380 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 66/132] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:01 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:39:01.799852 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-12cb06ec-5b58-4adf-bbed-6b24afeb0e6a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:01.800616 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-12cb06ec-5b58-4adf-bbed-6b24afeb0e6a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:01.815221 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-12cb06ec-5b58-4adf-bbed-6b24afeb0e6a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:01.817034 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-12cb06ec-5b58-4adf-bbed-6b24afeb0e6a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:01.906230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-4bd30959-e6cd-4a66-8fef-c9c593e1fcb0 req-d5cceb54-0306-4e66-b0a5-9f3d8b91fff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b182b81-371c-4244-b016-dffa07121ef2", "name": "network-vif-plugged", "status": "completed", "tag": "90ad1ea9-d70f-404f-aa76-239fd7557f37"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:01.907990 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:39:01.907990 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:39:01.921980 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-4bd30959-e6cd-4a66-8fef-c9c593e1fcb0 req-d5cceb54-0306-4e66-b0a5-9f3d8b91fff9 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:01.922432 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-4bd30959-e6cd-4a66-8fef-c9c593e1fcb0 req-d5cceb54-0306-4e66-b0a5-9f3d8b91fff9 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:01.937059 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-4bd30959-e6cd-4a66-8fef-c9c593e1fcb0 req-d5cceb54-0306-4e66-b0a5-9f3d8b91fff9 service nova] Creating event network-vif-plugged:90ad1ea9-d70f-404f-aa76-239fd7557f37 for instance 4b182b81-371c-4244-b016-dffa07121ef2 on hv-cinder-81764 Nov 11 20:39:01.943821 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-4bd30959-e6cd-4a66-8fef-c9c593e1fcb0 req-d5cceb54-0306-4e66-b0a5-9f3d8b91fff9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151077 Nov 11 20:39:01.945531 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 67/133] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:39:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:39:01.951914 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-df872f59-f00c-4f3d-be9e-56d1df0647e9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:01.952822 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-df872f59-f00c-4f3d-be9e-56d1df0647e9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:01.959880 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-df872f59-f00c-4f3d-be9e-56d1df0647e9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:01.960630 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-df872f59-f00c-4f3d-be9e-56d1df0647e9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:01.961622 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-df872f59-f00c-4f3d-be9e-56d1df0647e9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:01.962215 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-df872f59-f00c-4f3d-be9e-56d1df0647e9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:02.080400 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-12cb06ec-5b58-4adf-bbed-6b24afeb0e6a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:02.089744 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-12cb06ec-5b58-4adf-bbed-6b24afeb0e6a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.318194 Nov 11 20:39:02.090293 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 67/134] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:01 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:02.157167 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-df872f59-f00c-4f3d-be9e-56d1df0647e9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:02.169591 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-df872f59-f00c-4f3d-be9e-56d1df0647e9 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.221901 Nov 11 20:39:02.170228 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 68/135] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:01 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:02.789394 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0a935425-b10f-4719-99d0-b008497aacbf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:02.790599 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0a935425-b10f-4719-99d0-b008497aacbf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:02.796230 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a935425-b10f-4719-99d0-b008497aacbf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:02.796673 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a935425-b10f-4719-99d0-b008497aacbf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:02.797450 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a935425-b10f-4719-99d0-b008497aacbf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:02.797877 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a935425-b10f-4719-99d0-b008497aacbf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:02.808504 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ca580036-a928-4323-a188-f7b37e48bac8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:02.809098 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ca580036-a928-4323-a188-f7b37e48bac8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:02.817226 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca580036-a928-4323-a188-f7b37e48bac8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:02.819304 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca580036-a928-4323-a188-f7b37e48bac8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:02.820677 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca580036-a928-4323-a188-f7b37e48bac8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:02.821327 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca580036-a928-4323-a188-f7b37e48bac8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:03.018182 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0a935425-b10f-4719-99d0-b008497aacbf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:03.021888 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ca580036-a928-4323-a188-f7b37e48bac8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:03.029464 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0a935425-b10f-4719-99d0-b008497aacbf tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.247098 Nov 11 20:39:03.031204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ca580036-a928-4323-a188-f7b37e48bac8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:03.032707 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ca580036-a928-4323-a188-f7b37e48bac8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:03.033784 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ca580036-a928-4323-a188-f7b37e48bac8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.229162 Nov 11 20:39:03.034331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 69/136] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:02 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:39:03.042227 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 68/137] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:02 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:03.106881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a23b45eb-0c21-4877-bb27-2444d1ac768e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:03.107528 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a23b45eb-0c21-4877-bb27-2444d1ac768e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:03.116053 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a23b45eb-0c21-4877-bb27-2444d1ac768e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:03.116555 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a23b45eb-0c21-4877-bb27-2444d1ac768e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:03.117342 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a23b45eb-0c21-4877-bb27-2444d1ac768e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:03.117801 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a23b45eb-0c21-4877-bb27-2444d1ac768e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:03.188774 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0e04ba18-07cd-4adc-9f71-79c8cb216dd5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:03.192199 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0e04ba18-07cd-4adc-9f71-79c8cb216dd5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:03.202499 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0e04ba18-07cd-4adc-9f71-79c8cb216dd5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:03.202943 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0e04ba18-07cd-4adc-9f71-79c8cb216dd5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:03.203726 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0e04ba18-07cd-4adc-9f71-79c8cb216dd5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:03.204182 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0e04ba18-07cd-4adc-9f71-79c8cb216dd5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:03.317092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a23b45eb-0c21-4877-bb27-2444d1ac768e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:03.334601 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a23b45eb-0c21-4877-bb27-2444d1ac768e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.231122 Nov 11 20:39:03.336048 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 70/138] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:03 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:03.413317 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0e04ba18-07cd-4adc-9f71-79c8cb216dd5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:03.423705 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0e04ba18-07cd-4adc-9f71-79c8cb216dd5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.240777 Nov 11 20:39:03.425652 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 69/139] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:03 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:04.048638 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d2786180-60da-4648-a9ce-f7251c4e0069 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:04.049352 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d2786180-60da-4648-a9ce-f7251c4e0069 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:04.054217 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2789b299-5eac-437b-a4f2-9d0c8a74075e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:04.055360 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2789b299-5eac-437b-a4f2-9d0c8a74075e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:04.059243 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d2786180-60da-4648-a9ce-f7251c4e0069 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:04.061732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d2786180-60da-4648-a9ce-f7251c4e0069 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:04.062761 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d2786180-60da-4648-a9ce-f7251c4e0069 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:04.063829 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2789b299-5eac-437b-a4f2-9d0c8a74075e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:04.064388 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d2786180-60da-4648-a9ce-f7251c4e0069 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:04.064880 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2789b299-5eac-437b-a4f2-9d0c8a74075e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:04.066048 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2789b299-5eac-437b-a4f2-9d0c8a74075e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:04.066776 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2789b299-5eac-437b-a4f2-9d0c8a74075e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:04.785064 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-2789b299-5eac-437b-a4f2-9d0c8a74075e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:04.798821 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-2789b299-5eac-437b-a4f2-9d0c8a74075e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:04.802702 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-2789b299-5eac-437b-a4f2-9d0c8a74075e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:04.804562 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2789b299-5eac-437b-a4f2-9d0c8a74075e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.756140 Nov 11 20:39:04.806628 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 70/140] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:04 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:39:04.827369 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-163e2b0a-4a5d-4859-bcb2-29c87efa4604 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:04.828355 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-163e2b0a-4a5d-4859-bcb2-29c87efa4604 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:04.853692 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-163e2b0a-4a5d-4859-bcb2-29c87efa4604 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:04.855246 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-163e2b0a-4a5d-4859-bcb2-29c87efa4604 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:04.856247 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-163e2b0a-4a5d-4859-bcb2-29c87efa4604 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:04.856870 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-163e2b0a-4a5d-4859-bcb2-29c87efa4604 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:04.861239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d2786180-60da-4648-a9ce-f7251c4e0069 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:04.882786 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d2786180-60da-4648-a9ce-f7251c4e0069 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.829883 Nov 11 20:39:04.887280 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 71/141] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:04 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:04.896273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-92a4845e-d6a1-48a6-bc85-16052ee22ad2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:04.897869 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-92a4845e-d6a1-48a6-bc85-16052ee22ad2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:04.919795 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-92a4845e-d6a1-48a6-bc85-16052ee22ad2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:04.920585 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-92a4845e-d6a1-48a6-bc85-16052ee22ad2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:04.924181 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-92a4845e-d6a1-48a6-bc85-16052ee22ad2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:04.924973 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-92a4845e-d6a1-48a6-bc85-16052ee22ad2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:05.313697 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-163e2b0a-4a5d-4859-bcb2-29c87efa4604 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:05.322031 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-163e2b0a-4a5d-4859-bcb2-29c87efa4604 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.514054 Nov 11 20:39:05.322926 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 71/142] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:04 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:05.328760 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-92a4845e-d6a1-48a6-bc85-16052ee22ad2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:05.336748 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-92a4845e-d6a1-48a6-bc85-16052ee22ad2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.446783 Nov 11 20:39:05.337356 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 72/143] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:04 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:05.829564 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-396eb5d8-cb5a-4955-a410-f5dd53325bd9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:05.830179 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-396eb5d8-cb5a-4955-a410-f5dd53325bd9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:05.838726 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-396eb5d8-cb5a-4955-a410-f5dd53325bd9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:05.840479 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-396eb5d8-cb5a-4955-a410-f5dd53325bd9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:05.842124 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-396eb5d8-cb5a-4955-a410-f5dd53325bd9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:05.843168 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-396eb5d8-cb5a-4955-a410-f5dd53325bd9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:05.903635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a10809ca-36c5-4a0d-a313-2fd3899fab35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:05.906363 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a10809ca-36c5-4a0d-a313-2fd3899fab35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:05.916566 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a10809ca-36c5-4a0d-a313-2fd3899fab35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:05.918203 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a10809ca-36c5-4a0d-a313-2fd3899fab35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:05.919643 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a10809ca-36c5-4a0d-a313-2fd3899fab35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:05.920383 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a10809ca-36c5-4a0d-a313-2fd3899fab35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:06.245451 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-396eb5d8-cb5a-4955-a410-f5dd53325bd9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:06.264420 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-396eb5d8-cb5a-4955-a410-f5dd53325bd9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:06.266030 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-396eb5d8-cb5a-4955-a410-f5dd53325bd9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:06.267417 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-396eb5d8-cb5a-4955-a410-f5dd53325bd9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.445939 Nov 11 20:39:06.268383 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 72/144] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:05 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:39:06.276342 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a10809ca-36c5-4a0d-a313-2fd3899fab35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:06.289031 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a10809ca-36c5-4a0d-a313-2fd3899fab35 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.389721 Nov 11 20:39:06.294359 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 73/145] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:05 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:06.339203 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d7799004-f229-4b9a-a3df-9b0cf2ec870d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:06.340691 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d7799004-f229-4b9a-a3df-9b0cf2ec870d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:06.348156 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d7799004-f229-4b9a-a3df-9b0cf2ec870d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:06.348900 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d7799004-f229-4b9a-a3df-9b0cf2ec870d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:06.349845 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d7799004-f229-4b9a-a3df-9b0cf2ec870d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:06.350466 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d7799004-f229-4b9a-a3df-9b0cf2ec870d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:06.359573 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0d19b273-a76c-4695-bd96-ffd487289358 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:06.360635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0d19b273-a76c-4695-bd96-ffd487289358 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:06.372887 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d19b273-a76c-4695-bd96-ffd487289358 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:06.373480 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d19b273-a76c-4695-bd96-ffd487289358 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:06.378771 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d19b273-a76c-4695-bd96-ffd487289358 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:06.380022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d19b273-a76c-4695-bd96-ffd487289358 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:06.671714 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d7799004-f229-4b9a-a3df-9b0cf2ec870d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:06.682921 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d7799004-f229-4b9a-a3df-9b0cf2ec870d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.346298 Nov 11 20:39:06.684764 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 73/146] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:06 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:06.708779 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0d19b273-a76c-4695-bd96-ffd487289358 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:06.718356 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0d19b273-a76c-4695-bd96-ffd487289358 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.367649 Nov 11 20:39:06.718943 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 74/147] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:06 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:06.861819 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-8f1f1812-8d1e-4e78-8333-496ef28f7240 req-d81899ec-5fdd-4244-b193-6af8a56a6788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e9bc60a-d6ec-4b5a-a39f-5430afa0b859", "name": "network-vif-plugged", "status": "completed", "tag": "767cb3d9-cf56-4615-8623-4ec857595582"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:06.864180 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:39:06.864180 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:39:06.876625 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-8f1f1812-8d1e-4e78-8333-496ef28f7240 req-d81899ec-5fdd-4244-b193-6af8a56a6788 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:06.881094 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-8f1f1812-8d1e-4e78-8333-496ef28f7240 req-d81899ec-5fdd-4244-b193-6af8a56a6788 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:06.907339 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-8f1f1812-8d1e-4e78-8333-496ef28f7240 req-d81899ec-5fdd-4244-b193-6af8a56a6788 service nova] Creating event network-vif-plugged:767cb3d9-cf56-4615-8623-4ec857595582 for instance 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 on hv-cinder-81764 Nov 11 20:39:06.919086 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-8f1f1812-8d1e-4e78-8333-496ef28f7240 req-d81899ec-5fdd-4244-b193-6af8a56a6788 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061656 Nov 11 20:39:06.922117 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 74/148] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:39:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:39:07.289609 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6d98ea79-1072-48e4-a98a-0047524c27b8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:07.290610 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6d98ea79-1072-48e4-a98a-0047524c27b8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:07.302929 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6d98ea79-1072-48e4-a98a-0047524c27b8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:07.311678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f43ba36e-789b-441d-9ca7-6a5d63d4f0ae tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:07.312993 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f43ba36e-789b-441d-9ca7-6a5d63d4f0ae tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:07.317862 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6d98ea79-1072-48e4-a98a-0047524c27b8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:07.322233 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6d98ea79-1072-48e4-a98a-0047524c27b8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:07.324461 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6d98ea79-1072-48e4-a98a-0047524c27b8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:07.330225 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f43ba36e-789b-441d-9ca7-6a5d63d4f0ae tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:07.338874 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f43ba36e-789b-441d-9ca7-6a5d63d4f0ae tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:07.341457 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f43ba36e-789b-441d-9ca7-6a5d63d4f0ae tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:07.350075 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f43ba36e-789b-441d-9ca7-6a5d63d4f0ae tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:07.808140 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f43ba36e-789b-441d-9ca7-6a5d63d4f0ae tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:07.822217 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f43ba36e-789b-441d-9ca7-6a5d63d4f0ae tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1315 microversion: 2.1 time: 0.515070 Nov 11 20:39:07.824596 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 75/149] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:07 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:07.829910 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d26b6540-de86-4d6b-9fd2-09bcbd13afa2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:07.831014 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d26b6540-de86-4d6b-9fd2-09bcbd13afa2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:07.839270 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d26b6540-de86-4d6b-9fd2-09bcbd13afa2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:07.839919 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d26b6540-de86-4d6b-9fd2-09bcbd13afa2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:07.841102 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d26b6540-de86-4d6b-9fd2-09bcbd13afa2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:07.841823 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d26b6540-de86-4d6b-9fd2-09bcbd13afa2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:07.877949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6d98ea79-1072-48e4-a98a-0047524c27b8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:07.905307 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6d98ea79-1072-48e4-a98a-0047524c27b8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:07.907014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6d98ea79-1072-48e4-a98a-0047524c27b8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:07.908813 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6d98ea79-1072-48e4-a98a-0047524c27b8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.625600 Nov 11 20:39:07.924104 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 75/150] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:07 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:39:07.933973 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f6a10aa6-76e1-44d5-94ff-e6a5a0f467ef tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:07.938068 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f6a10aa6-76e1-44d5-94ff-e6a5a0f467ef tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:07.953405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6a10aa6-76e1-44d5-94ff-e6a5a0f467ef tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:07.953856 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6a10aa6-76e1-44d5-94ff-e6a5a0f467ef tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:07.956597 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6a10aa6-76e1-44d5-94ff-e6a5a0f467ef tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:07.957033 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6a10aa6-76e1-44d5-94ff-e6a5a0f467ef tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:08.161598 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d26b6540-de86-4d6b-9fd2-09bcbd13afa2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:08.173135 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d26b6540-de86-4d6b-9fd2-09bcbd13afa2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1321 microversion: 2.1 time: 0.346714 Nov 11 20:39:08.173729 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 76/151] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:07 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:08.198451 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f6a10aa6-76e1-44d5-94ff-e6a5a0f467ef tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:08.205914 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f6a10aa6-76e1-44d5-94ff-e6a5a0f467ef tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.280666 Nov 11 20:39:08.215287 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 76/152] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:07 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:08.840732 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3426401d-f8b3-4b48-9ba2-f707c0622a42 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:08.841401 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3426401d-f8b3-4b48-9ba2-f707c0622a42 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:08.850404 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3426401d-f8b3-4b48-9ba2-f707c0622a42 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:08.851786 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3426401d-f8b3-4b48-9ba2-f707c0622a42 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:08.852643 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3426401d-f8b3-4b48-9ba2-f707c0622a42 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:08.854015 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3426401d-f8b3-4b48-9ba2-f707c0622a42 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:08.931528 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1729bb9a-49d4-460f-91c0-4db69268367a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:08.932947 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1729bb9a-49d4-460f-91c0-4db69268367a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:08.941698 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1729bb9a-49d4-460f-91c0-4db69268367a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:08.944359 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1729bb9a-49d4-460f-91c0-4db69268367a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:08.945954 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1729bb9a-49d4-460f-91c0-4db69268367a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:08.946724 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1729bb9a-49d4-460f-91c0-4db69268367a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:09.387601 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3426401d-f8b3-4b48-9ba2-f707c0622a42 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:09.395940 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3426401d-f8b3-4b48-9ba2-f707c0622a42 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1501 microversion: 2.1 time: 0.559052 Nov 11 20:39:09.397966 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 77/153] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:08 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1501 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:09.418524 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-6ecd81ac-1519-4cf0-83fc-dc19ed59556f req-83363e94-c4b1-407c-aff4-edad8ce92e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2a29b9-345d-48ed-ab58-999c80cd44d8", "name": "network-vif-plugged", "status": "completed", "tag": "a1e7e113-49ef-49f9-9fd9-7534d076360a"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:09.423193 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:39:09.423193 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:39:09.434373 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1729bb9a-49d4-460f-91c0-4db69268367a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:09.445086 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-6ecd81ac-1519-4cf0-83fc-dc19ed59556f req-83363e94-c4b1-407c-aff4-edad8ce92e47 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:09.445598 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-6ecd81ac-1519-4cf0-83fc-dc19ed59556f req-83363e94-c4b1-407c-aff4-edad8ce92e47 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:09.453838 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1729bb9a-49d4-460f-91c0-4db69268367a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:09.459348 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1729bb9a-49d4-460f-91c0-4db69268367a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:09.463437 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1729bb9a-49d4-460f-91c0-4db69268367a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.538770 Nov 11 20:39:09.465844 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 77/154] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:08 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:39:09.490970 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-64d2959b-7040-4d0e-a445-deead59ef9bc tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:09.495404 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-64d2959b-7040-4d0e-a445-deead59ef9bc tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:09.498089 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-6ecd81ac-1519-4cf0-83fc-dc19ed59556f req-83363e94-c4b1-407c-aff4-edad8ce92e47 service nova] Creating event network-vif-plugged:a1e7e113-49ef-49f9-9fd9-7534d076360a for instance aa2a29b9-345d-48ed-ab58-999c80cd44d8 on hv-cinder-81764 Nov 11 20:39:09.505518 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-6ecd81ac-1519-4cf0-83fc-dc19ed59556f req-83363e94-c4b1-407c-aff4-edad8ce92e47 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100930 Nov 11 20:39:09.506489 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 78/155] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:39:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:39:09.512920 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ba2ac222-a4b4-437b-9d79-19c141b3eb55 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:09.513739 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ba2ac222-a4b4-437b-9d79-19c141b3eb55 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:09.515715 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-64d2959b-7040-4d0e-a445-deead59ef9bc tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:09.519417 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-64d2959b-7040-4d0e-a445-deead59ef9bc tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:09.521069 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-64d2959b-7040-4d0e-a445-deead59ef9bc tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:09.525863 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-64d2959b-7040-4d0e-a445-deead59ef9bc tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:09.538933 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ba2ac222-a4b4-437b-9d79-19c141b3eb55 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:09.539375 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ba2ac222-a4b4-437b-9d79-19c141b3eb55 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:09.544997 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ba2ac222-a4b4-437b-9d79-19c141b3eb55 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:09.545844 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ba2ac222-a4b4-437b-9d79-19c141b3eb55 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:10.053358 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ba2ac222-a4b4-437b-9d79-19c141b3eb55 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:10.063038 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ba2ac222-a4b4-437b-9d79-19c141b3eb55 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.554961 Nov 11 20:39:10.064913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 79/156] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:09 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:10.121149 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-64d2959b-7040-4d0e-a445-deead59ef9bc tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:10.133834 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-64d2959b-7040-4d0e-a445-deead59ef9bc tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1516 microversion: 2.1 time: 0.665411 Nov 11 20:39:10.135009 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 78/157] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:09 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1516 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:10.165122 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-973eff8d-f18d-49e0-abb0-cb9a0f92e218 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:10.178700 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-973eff8d-f18d-49e0-abb0-cb9a0f92e218 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:10.194553 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-973eff8d-f18d-49e0-abb0-cb9a0f92e218 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:10.196973 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-973eff8d-f18d-49e0-abb0-cb9a0f92e218 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:10.198553 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-973eff8d-f18d-49e0-abb0-cb9a0f92e218 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:10.200322 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-973eff8d-f18d-49e0-abb0-cb9a0f92e218 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:10.407587 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.objects.instance [None req-973eff8d-f18d-49e0-abb0-cb9a0f92e218 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lazy-loading 'flavor' on Instance uuid 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 {{(pid=122527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:39:10.483959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c69742ec-46ce-4cc3-9767-a04c86c292ac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:10.484634 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c69742ec-46ce-4cc3-9767-a04c86c292ac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:10.501943 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c69742ec-46ce-4cc3-9767-a04c86c292ac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:10.502316 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c69742ec-46ce-4cc3-9767-a04c86c292ac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:10.504498 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c69742ec-46ce-4cc3-9767-a04c86c292ac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:10.504946 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c69742ec-46ce-4cc3-9767-a04c86c292ac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:10.672655 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-973eff8d-f18d-49e0-abb0-cb9a0f92e218 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "POST /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859/action" status: 200 len: 32 microversion: 2.1 time: 0.513599 Nov 11 20:39:10.675139 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 80/158] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:39:10 2021] POST /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859/action => generated 32 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:39:10.685400 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b878811f-45ce-49b6-9ce5-53e5c2209eb6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:10.686299 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b878811f-45ce-49b6-9ce5-53e5c2209eb6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:10.696567 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b878811f-45ce-49b6-9ce5-53e5c2209eb6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:10.697302 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b878811f-45ce-49b6-9ce5-53e5c2209eb6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:10.698262 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b878811f-45ce-49b6-9ce5-53e5c2209eb6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:10.699182 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b878811f-45ce-49b6-9ce5-53e5c2209eb6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:10.870139 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c69742ec-46ce-4cc3-9767-a04c86c292ac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:10.878248 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c69742ec-46ce-4cc3-9767-a04c86c292ac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:10.888437 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c69742ec-46ce-4cc3-9767-a04c86c292ac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:10.889857 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c69742ec-46ce-4cc3-9767-a04c86c292ac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.409727 Nov 11 20:39:10.890867 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 79/159] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:10 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:39:11.081376 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b878811f-45ce-49b6-9ce5-53e5c2209eb6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:11.083003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4a6fa00d-726d-4619-84f4-152f7ec95074 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:11.083725 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4a6fa00d-726d-4619-84f4-152f7ec95074 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:11.090610 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b878811f-45ce-49b6-9ce5-53e5c2209eb6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.410334 Nov 11 20:39:11.090988 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4a6fa00d-726d-4619-84f4-152f7ec95074 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:11.091440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4a6fa00d-726d-4619-84f4-152f7ec95074 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:11.092253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4a6fa00d-726d-4619-84f4-152f7ec95074 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:11.096348 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4a6fa00d-726d-4619-84f4-152f7ec95074 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:11.105728 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 81/160] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:10 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:11.247669 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-67b66468-546c-4462-bae9-ff39c4d9ad19 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5edcd670-1b74-4b5a-a7fa-da31ba361652"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:11.249905 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-67b66468-546c-4462-bae9-ff39c4d9ad19 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:11.271592 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-67b66468-546c-4462-bae9-ff39c4d9ad19 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:11.273926 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-67b66468-546c-4462-bae9-ff39c4d9ad19 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:11.275446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-67b66468-546c-4462-bae9-ff39c4d9ad19 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:11.278607 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-67b66468-546c-4462-bae9-ff39c4d9ad19 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:11.338916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4a6fa00d-726d-4619-84f4-152f7ec95074 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:11.354884 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4a6fa00d-726d-4619-84f4-152f7ec95074 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.275051 Nov 11 20:39:11.357514 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 80/161] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:11 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:11.566377 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-41f4a4aa-428f-4211-b4e7-40981ae22a95 req-b555ade8-8ffa-4f69-aed0-93197b05365f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd75246-98f4-4479-be99-f39c6427cc92", "name": "network-vif-plugged", "status": "completed", "tag": "66b27c9f-82a4-466b-830b-548c3a8a129f"}, {"server_uuid": "ce4a9f51-80d0-4901-beaf-9b03435f002c", "name": "network-vif-plugged", "status": "completed", "tag": "bc0e19f0-bdca-4923-a0c3-77ad0c202bdc"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:11.569923 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:39:11.569923 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:39:11.585503 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-41f4a4aa-428f-4211-b4e7-40981ae22a95 req-b555ade8-8ffa-4f69-aed0-93197b05365f service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:11.587622 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-41f4a4aa-428f-4211-b4e7-40981ae22a95 req-b555ade8-8ffa-4f69-aed0-93197b05365f service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:11.619130 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-41f4a4aa-428f-4211-b4e7-40981ae22a95 req-b555ade8-8ffa-4f69-aed0-93197b05365f service nova] Creating event network-vif-plugged:66b27c9f-82a4-466b-830b-548c3a8a129f for instance ddd75246-98f4-4479-be99-f39c6427cc92 on hv-cinder-81764 Nov 11 20:39:11.622971 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-41f4a4aa-428f-4211-b4e7-40981ae22a95 req-b555ade8-8ffa-4f69-aed0-93197b05365f service nova] Creating event network-vif-plugged:bc0e19f0-bdca-4923-a0c3-77ad0c202bdc for instance ce4a9f51-80d0-4901-beaf-9b03435f002c on hv-cinder-81764 Nov 11 20:39:11.652349 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-41f4a4aa-428f-4211-b4e7-40981ae22a95 req-b555ade8-8ffa-4f69-aed0-93197b05365f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090181 Nov 11 20:39:11.654321 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 81/162] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:39:11 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:39:11.915845 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ff16e9fc-0d4b-493d-be20-a45803d994ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:11.917149 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ff16e9fc-0d4b-493d-be20-a45803d994ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:11.934190 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ff16e9fc-0d4b-493d-be20-a45803d994ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:11.934190 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ff16e9fc-0d4b-493d-be20-a45803d994ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:11.934356 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ff16e9fc-0d4b-493d-be20-a45803d994ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:11.936112 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ff16e9fc-0d4b-493d-be20-a45803d994ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:12.218253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ff16e9fc-0d4b-493d-be20-a45803d994ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:12.232375 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ff16e9fc-0d4b-493d-be20-a45803d994ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:12.233912 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ff16e9fc-0d4b-493d-be20-a45803d994ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:12.235892 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ff16e9fc-0d4b-493d-be20-a45803d994ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.325428 Nov 11 20:39:12.236718 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 82/163] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:11 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:39:12.245446 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f12b0f4f-827a-4b3a-8e9b-a4f3360e0b98 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:12.246376 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f12b0f4f-827a-4b3a-8e9b-a4f3360e0b98 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:12.255581 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f12b0f4f-827a-4b3a-8e9b-a4f3360e0b98 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:12.258316 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f12b0f4f-827a-4b3a-8e9b-a4f3360e0b98 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:12.259394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f12b0f4f-827a-4b3a-8e9b-a4f3360e0b98 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:12.262035 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f12b0f4f-827a-4b3a-8e9b-a4f3360e0b98 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:12.506440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f12b0f4f-827a-4b3a-8e9b-a4f3360e0b98 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:12.518464 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f12b0f4f-827a-4b3a-8e9b-a4f3360e0b98 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.279870 Nov 11 20:39:12.530386 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 83/164] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:12 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:12.535070 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-93fd9ed5-7450-451a-b13f-a642ad6f53e3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:12.536763 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-93fd9ed5-7450-451a-b13f-a642ad6f53e3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:12.543944 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-93fd9ed5-7450-451a-b13f-a642ad6f53e3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:12.544675 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-93fd9ed5-7450-451a-b13f-a642ad6f53e3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:12.545623 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-93fd9ed5-7450-451a-b13f-a642ad6f53e3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:12.546204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-93fd9ed5-7450-451a-b13f-a642ad6f53e3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:12.806267 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-93fd9ed5-7450-451a-b13f-a642ad6f53e3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:12.828143 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-93fd9ed5-7450-451a-b13f-a642ad6f53e3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.296426 Nov 11 20:39:12.832580 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 84/165] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:12 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:13.259791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3aad3e74-8fa2-4add-b4fe-d9519d2e3366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:13.260883 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3aad3e74-8fa2-4add-b4fe-d9519d2e3366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:13.274621 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3aad3e74-8fa2-4add-b4fe-d9519d2e3366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:13.276421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3aad3e74-8fa2-4add-b4fe-d9519d2e3366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:13.278522 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3aad3e74-8fa2-4add-b4fe-d9519d2e3366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:13.281477 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3aad3e74-8fa2-4add-b4fe-d9519d2e3366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:13.649572 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3aad3e74-8fa2-4add-b4fe-d9519d2e3366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:13.661427 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3aad3e74-8fa2-4add-b4fe-d9519d2e3366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:13.664703 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3aad3e74-8fa2-4add-b4fe-d9519d2e3366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:13.666707 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3aad3e74-8fa2-4add-b4fe-d9519d2e3366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.414340 Nov 11 20:39:13.667835 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 85/166] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:13 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:39:13.676571 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2cbafbd3-d20c-4550-bff2-9173556bceba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:13.677392 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2cbafbd3-d20c-4550-bff2-9173556bceba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:13.688470 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2cbafbd3-d20c-4550-bff2-9173556bceba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:13.688996 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2cbafbd3-d20c-4550-bff2-9173556bceba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:13.690933 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2cbafbd3-d20c-4550-bff2-9173556bceba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:13.691381 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2cbafbd3-d20c-4550-bff2-9173556bceba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:13.926398 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2cbafbd3-d20c-4550-bff2-9173556bceba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:13.951805 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2cbafbd3-d20c-4550-bff2-9173556bceba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.272248 Nov 11 20:39:13.955343 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 86/167] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:13 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:13.963804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f4fda1ee-903a-4e88-9046-6a5f2614d761 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:13.964941 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f4fda1ee-903a-4e88-9046-6a5f2614d761 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:13.975057 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f4fda1ee-903a-4e88-9046-6a5f2614d761 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:13.975790 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f4fda1ee-903a-4e88-9046-6a5f2614d761 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:13.977153 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f4fda1ee-903a-4e88-9046-6a5f2614d761 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:13.978106 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f4fda1ee-903a-4e88-9046-6a5f2614d761 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:14.246120 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f4fda1ee-903a-4e88-9046-6a5f2614d761 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:14.259792 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f4fda1ee-903a-4e88-9046-6a5f2614d761 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1318 microversion: 2.1 time: 0.300422 Nov 11 20:39:14.260781 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 87/168] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:13 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:14.686811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c36f0a04-7399-4080-84f0-b8868802e27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:14.688952 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c36f0a04-7399-4080-84f0-b8868802e27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:14.711401 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c36f0a04-7399-4080-84f0-b8868802e27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:14.725253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c36f0a04-7399-4080-84f0-b8868802e27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:14.727328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c36f0a04-7399-4080-84f0-b8868802e27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:14.731012 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c36f0a04-7399-4080-84f0-b8868802e27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:15.376136 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-67b66468-546c-4462-bae9-ff39c4d9ad19 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "POST /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.129164 Nov 11 20:39:15.376855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 82/169] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:39:11 2021] POST /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2/os-volume_attachments => generated 194 bytes in 4136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:39:15.395167 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c2eb19d9-9da7-4233-9c08-f088a9d26b55 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:15.397872 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c2eb19d9-9da7-4233-9c08-f088a9d26b55 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:15.414709 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c2eb19d9-9da7-4233-9c08-f088a9d26b55 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:15.417896 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c2eb19d9-9da7-4233-9c08-f088a9d26b55 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:15.419625 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c2eb19d9-9da7-4233-9c08-f088a9d26b55 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:15.420830 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c2eb19d9-9da7-4233-9c08-f088a9d26b55 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:16.206523 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c2eb19d9-9da7-4233-9c08-f088a9d26b55 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:16.215206 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c2eb19d9-9da7-4233-9c08-f088a9d26b55 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.832489 Nov 11 20:39:16.222299 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 83/170] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:15 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:16.234972 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-502572ae-3e1f-412f-b67a-528427005785 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:16.235594 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-502572ae-3e1f-412f-b67a-528427005785 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:16.259070 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-502572ae-3e1f-412f-b67a-528427005785 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:16.259526 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-502572ae-3e1f-412f-b67a-528427005785 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:16.260356 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-502572ae-3e1f-412f-b67a-528427005785 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:16.260788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-502572ae-3e1f-412f-b67a-528427005785 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:16.283550 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c36f0a04-7399-4080-84f0-b8868802e27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:16.293267 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c36f0a04-7399-4080-84f0-b8868802e27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:16.296042 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c36f0a04-7399-4080-84f0-b8868802e27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:16.297512 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c36f0a04-7399-4080-84f0-b8868802e27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 1.614767 Nov 11 20:39:16.319479 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 88/171] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:14 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:39:16.617416 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-502572ae-3e1f-412f-b67a-528427005785 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:16.625236 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-502572ae-3e1f-412f-b67a-528427005785 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1507 microversion: 2.1 time: 0.401240 Nov 11 20:39:16.633668 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 84/172] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:16 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1507 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:17.233457 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-97132496-50b5-47dc-90cd-a2703bee6e37 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:17.234837 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-97132496-50b5-47dc-90cd-a2703bee6e37 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:17.246930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97132496-50b5-47dc-90cd-a2703bee6e37 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:17.255399 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97132496-50b5-47dc-90cd-a2703bee6e37 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:17.256406 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97132496-50b5-47dc-90cd-a2703bee6e37 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:17.256860 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97132496-50b5-47dc-90cd-a2703bee6e37 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:17.323490 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-70286def-1854-418c-b98a-8ab635c32ce3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:17.325001 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-70286def-1854-418c-b98a-8ab635c32ce3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:17.340592 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-70286def-1854-418c-b98a-8ab635c32ce3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:17.342085 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-70286def-1854-418c-b98a-8ab635c32ce3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:17.346885 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-70286def-1854-418c-b98a-8ab635c32ce3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:17.351040 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-70286def-1854-418c-b98a-8ab635c32ce3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:17.874017 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-97132496-50b5-47dc-90cd-a2703bee6e37 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:17.893449 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-97132496-50b5-47dc-90cd-a2703bee6e37 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.662153 Nov 11 20:39:17.916243 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 89/173] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:17 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:18.222619 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-70286def-1854-418c-b98a-8ab635c32ce3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:18.237755 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-70286def-1854-418c-b98a-8ab635c32ce3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:18.245229 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-70286def-1854-418c-b98a-8ab635c32ce3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:18.250026 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-70286def-1854-418c-b98a-8ab635c32ce3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1407 microversion: 2.20 time: 0.933017 Nov 11 20:39:18.251415 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 85/174] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:17 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1407 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:39:18.612119 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3a088b51-f527-43d6-a523-69f32a588a22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "228e8e4e-b464-4d56-8e71-fdf7daf0ba61"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:18.613837 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3a088b51-f527-43d6-a523-69f32a588a22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:18.621525 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3a088b51-f527-43d6-a523-69f32a588a22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:18.623558 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3a088b51-f527-43d6-a523-69f32a588a22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:18.625552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3a088b51-f527-43d6-a523-69f32a588a22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:18.629931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3a088b51-f527-43d6-a523-69f32a588a22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:18.922408 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b787c3e1-1fed-46dc-aeda-5e90ee539559 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:18.923855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b787c3e1-1fed-46dc-aeda-5e90ee539559 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:18.933863 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b787c3e1-1fed-46dc-aeda-5e90ee539559 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:18.935370 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b787c3e1-1fed-46dc-aeda-5e90ee539559 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:18.936344 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b787c3e1-1fed-46dc-aeda-5e90ee539559 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:18.937393 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b787c3e1-1fed-46dc-aeda-5e90ee539559 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:19.235842 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b787c3e1-1fed-46dc-aeda-5e90ee539559 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:19.252642 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b787c3e1-1fed-46dc-aeda-5e90ee539559 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.338771 Nov 11 20:39:19.253538 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 86/175] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:18 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:19.263572 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3a088b51-f527-43d6-a523-69f32a588a22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "POST /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.653953 Nov 11 20:39:19.263572 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 90/176] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:39:18 2021] POST /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8/os-volume_attachments => generated 194 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:39:19.272579 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ce43192c-1642-41c3-9af1-0c9572a15206 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:19.274081 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ce43192c-1642-41c3-9af1-0c9572a15206 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:19.283289 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce43192c-1642-41c3-9af1-0c9572a15206 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:19.283743 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce43192c-1642-41c3-9af1-0c9572a15206 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:19.284630 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce43192c-1642-41c3-9af1-0c9572a15206 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:19.285067 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce43192c-1642-41c3-9af1-0c9572a15206 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:19.620079 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ce43192c-1642-41c3-9af1-0c9572a15206 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:19.642897 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ce43192c-1642-41c3-9af1-0c9572a15206 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:19.647244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ce43192c-1642-41c3-9af1-0c9572a15206 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:19.651194 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ce43192c-1642-41c3-9af1-0c9572a15206 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1598 microversion: 2.20 time: 0.385355 Nov 11 20:39:19.677383 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-13d1325e-c2cb-4463-ad4f-15e68c1cb176 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:19.677986 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-13d1325e-c2cb-4463-ad4f-15e68c1cb176 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:19.682294 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 87/177] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:39:19 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1598 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:39:19.697394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13d1325e-c2cb-4463-ad4f-15e68c1cb176 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:19.697881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13d1325e-c2cb-4463-ad4f-15e68c1cb176 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:19.698710 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13d1325e-c2cb-4463-ad4f-15e68c1cb176 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:19.699472 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13d1325e-c2cb-4463-ad4f-15e68c1cb176 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:19.879878 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-13d1325e-c2cb-4463-ad4f-15e68c1cb176 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.207050 Nov 11 20:39:19.880516 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 91/178] 10.222.0.61 () {60 vars in 1315 bytes} [Thu Nov 11 20:39:19 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:39:20.270389 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9bad73d0-1cc1-47a5-9488-ff72a406ace4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:20.271833 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9bad73d0-1cc1-47a5-9488-ff72a406ace4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:20.287481 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9bad73d0-1cc1-47a5-9488-ff72a406ace4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:20.288322 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9bad73d0-1cc1-47a5-9488-ff72a406ace4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:20.289408 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9bad73d0-1cc1-47a5-9488-ff72a406ace4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:20.290085 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9bad73d0-1cc1-47a5-9488-ff72a406ace4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:20.982101 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9bad73d0-1cc1-47a5-9488-ff72a406ace4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:20.998092 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9bad73d0-1cc1-47a5-9488-ff72a406ace4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.723908 Nov 11 20:39:20.999274 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 88/179] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:20 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:22.020651 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2f3d3bad-d66d-4830-bfdb-f45d5ed81dd2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:22.021388 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2f3d3bad-d66d-4830-bfdb-f45d5ed81dd2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:22.030073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2f3d3bad-d66d-4830-bfdb-f45d5ed81dd2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:22.030525 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2f3d3bad-d66d-4830-bfdb-f45d5ed81dd2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:22.035495 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2f3d3bad-d66d-4830-bfdb-f45d5ed81dd2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:22.037969 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2f3d3bad-d66d-4830-bfdb-f45d5ed81dd2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:22.511994 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2f3d3bad-d66d-4830-bfdb-f45d5ed81dd2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:22.519474 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2f3d3bad-d66d-4830-bfdb-f45d5ed81dd2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.503522 Nov 11 20:39:22.520640 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 92/180] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:22 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:22.833462 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-bb18de68-cf15-4c45-bc1f-1bd970961131 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:22.834521 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-bb18de68-cf15-4c45-bc1f-1bd970961131 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:22.854669 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bb18de68-cf15-4c45-bc1f-1bd970961131 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:22.855218 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bb18de68-cf15-4c45-bc1f-1bd970961131 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:22.856273 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bb18de68-cf15-4c45-bc1f-1bd970961131 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:22.864352 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-3a03e883-d97c-40fa-adc0-468db05d7ec8 req-d63edcf7-2231-43f5-a1aa-34b8024ce0ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce4a9f51-80d0-4901-beaf-9b03435f002c", "tag": "bc0e19f0-bdca-4923-a0c3-77ad0c202bdc"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:22.866590 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:39:22.866590 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:39:22.873926 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bb18de68-cf15-4c45-bc1f-1bd970961131 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:22.885645 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-3a03e883-d97c-40fa-adc0-468db05d7ec8 req-d63edcf7-2231-43f5-a1aa-34b8024ce0ab service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:22.890400 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-3a03e883-d97c-40fa-adc0-468db05d7ec8 req-d63edcf7-2231-43f5-a1aa-34b8024ce0ab service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:22.934095 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-3a03e883-d97c-40fa-adc0-468db05d7ec8 req-d63edcf7-2231-43f5-a1aa-34b8024ce0ab service nova] Creating event network-changed:bc0e19f0-bdca-4923-a0c3-77ad0c202bdc for instance ce4a9f51-80d0-4901-beaf-9b03435f002c on hv-cinder-81764 Nov 11 20:39:22.944969 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-3a03e883-d97c-40fa-adc0-468db05d7ec8 req-d63edcf7-2231-43f5-a1aa-34b8024ce0ab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084792 Nov 11 20:39:22.945573 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 93/181] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:39:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:39:23.025333 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-bb18de68-cf15-4c45-bc1f-1bd970961131 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.195819 Nov 11 20:39:23.026154 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 89/182] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:22 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:23.539282 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3c74eeb7-7c41-4d2a-b7b6-deba9a94d81d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:23.539993 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3c74eeb7-7c41-4d2a-b7b6-deba9a94d81d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:23.563768 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3c74eeb7-7c41-4d2a-b7b6-deba9a94d81d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:23.571016 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3c74eeb7-7c41-4d2a-b7b6-deba9a94d81d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:23.571899 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3c74eeb7-7c41-4d2a-b7b6-deba9a94d81d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:23.572409 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3c74eeb7-7c41-4d2a-b7b6-deba9a94d81d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:24.038698 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-47ad4e9d-5968-48f3-91e5-ce6d79cabf4f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:24.040580 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-47ad4e9d-5968-48f3-91e5-ce6d79cabf4f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:24.058300 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-47ad4e9d-5968-48f3-91e5-ce6d79cabf4f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:24.061975 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-47ad4e9d-5968-48f3-91e5-ce6d79cabf4f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:24.066070 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-47ad4e9d-5968-48f3-91e5-ce6d79cabf4f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:24.069006 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-47ad4e9d-5968-48f3-91e5-ce6d79cabf4f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:24.306875 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-47ad4e9d-5968-48f3-91e5-ce6d79cabf4f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.273481 Nov 11 20:39:24.318584 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 90/183] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:24 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:24.842517 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3c74eeb7-7c41-4d2a-b7b6-deba9a94d81d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:24.851272 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3c74eeb7-7c41-4d2a-b7b6-deba9a94d81d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 1.316703 Nov 11 20:39:24.853750 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 94/184] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:23 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:25.323496 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-21f76773-90a0-4782-ac6e-5ba1af19a065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:25.324482 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-21f76773-90a0-4782-ac6e-5ba1af19a065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:25.352632 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-21f76773-90a0-4782-ac6e-5ba1af19a065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:25.353137 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-21f76773-90a0-4782-ac6e-5ba1af19a065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:25.353850 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-21f76773-90a0-4782-ac6e-5ba1af19a065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:25.354283 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-21f76773-90a0-4782-ac6e-5ba1af19a065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:25.513953 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-21f76773-90a0-4782-ac6e-5ba1af19a065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.195349 Nov 11 20:39:25.514954 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 91/185] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:25 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:25.607627 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f5182902-fa21-4a11-9abf-a36bc5b24f4b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:25.609983 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f5182902-fa21-4a11-9abf-a36bc5b24f4b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:25.618287 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f5182902-fa21-4a11-9abf-a36bc5b24f4b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:25.618991 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f5182902-fa21-4a11-9abf-a36bc5b24f4b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:25.620159 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f5182902-fa21-4a11-9abf-a36bc5b24f4b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:25.620836 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f5182902-fa21-4a11-9abf-a36bc5b24f4b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:25.650088 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f5182902-fa21-4a11-9abf-a36bc5b24f4b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Going to try to terminate instance {{(pid=122526) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:39:25.872144 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-443997d0-cd5d-42f6-a1d3-4994021e4242 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:25.873141 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-443997d0-cd5d-42f6-a1d3-4994021e4242 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:25.886699 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f5182902-fa21-4a11-9abf-a36bc5b24f4b tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 204 len: 0 microversion: 2.1 time: 0.283590 Nov 11 20:39:25.888062 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 95/186] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:39:25 2021] DELETE /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:39:25.890927 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-443997d0-cd5d-42f6-a1d3-4994021e4242 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:25.891387 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-443997d0-cd5d-42f6-a1d3-4994021e4242 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:25.893300 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-443997d0-cd5d-42f6-a1d3-4994021e4242 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:25.896621 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-443997d0-cd5d-42f6-a1d3-4994021e4242 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:25.939710 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5380d24f-5bd8-4637-b32a-2a1a153685be tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:25.941327 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5380d24f-5bd8-4637-b32a-2a1a153685be tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:25.974177 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5380d24f-5bd8-4637-b32a-2a1a153685be tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:25.978616 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5380d24f-5bd8-4637-b32a-2a1a153685be tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:25.980425 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5380d24f-5bd8-4637-b32a-2a1a153685be tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:25.980894 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5380d24f-5bd8-4637-b32a-2a1a153685be tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:26.340554 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-443997d0-cd5d-42f6-a1d3-4994021e4242 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:26.355488 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-443997d0-cd5d-42f6-a1d3-4994021e4242 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.488203 Nov 11 20:39:26.362042 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 92/187] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:25 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:26.393168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5380d24f-5bd8-4637-b32a-2a1a153685be tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:26.401921 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5380d24f-5bd8-4637-b32a-2a1a153685be tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1553 microversion: 2.1 time: 0.466687 Nov 11 20:39:26.405020 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 96/188] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:25 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1553 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:26.525767 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-41329170-bbce-4fe0-9716-ef4d364d2cc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:26.527803 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-41329170-bbce-4fe0-9716-ef4d364d2cc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:26.539045 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-41329170-bbce-4fe0-9716-ef4d364d2cc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:26.539849 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-41329170-bbce-4fe0-9716-ef4d364d2cc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:26.543557 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-41329170-bbce-4fe0-9716-ef4d364d2cc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:26.544025 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-41329170-bbce-4fe0-9716-ef4d364d2cc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:26.686304 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-41329170-bbce-4fe0-9716-ef4d364d2cc3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.163907 Nov 11 20:39:26.687489 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 93/189] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:26 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:27.375524 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6d763483-1125-4857-9358-695c26db69ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:27.376191 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6d763483-1125-4857-9358-695c26db69ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:27.388521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6d763483-1125-4857-9358-695c26db69ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:27.388922 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6d763483-1125-4857-9358-695c26db69ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:27.390160 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6d763483-1125-4857-9358-695c26db69ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:27.390794 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6d763483-1125-4857-9358-695c26db69ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:27.421672 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2f1bd628-21c7-4e58-8c3e-2c979dd269aa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:27.423025 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2f1bd628-21c7-4e58-8c3e-2c979dd269aa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:27.430535 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f1bd628-21c7-4e58-8c3e-2c979dd269aa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:27.431297 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f1bd628-21c7-4e58-8c3e-2c979dd269aa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:27.432318 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f1bd628-21c7-4e58-8c3e-2c979dd269aa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:27.433051 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f1bd628-21c7-4e58-8c3e-2c979dd269aa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:27.657249 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-2f1bd628-21c7-4e58-8c3e-2c979dd269aa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:27.661637 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6d763483-1125-4857-9358-695c26db69ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:27.670914 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6d763483-1125-4857-9358-695c26db69ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.299340 Nov 11 20:39:27.671754 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 97/190] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:27 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:27.682586 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2f1bd628-21c7-4e58-8c3e-2c979dd269aa tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1553 microversion: 2.1 time: 0.264765 Nov 11 20:39:27.684278 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 94/191] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:27 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:27.699002 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5c18ede5-cb6e-4d4f-812f-54e4c8193639 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:27.700431 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5c18ede5-cb6e-4d4f-812f-54e4c8193639 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:27.710176 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c18ede5-cb6e-4d4f-812f-54e4c8193639 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:27.710818 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c18ede5-cb6e-4d4f-812f-54e4c8193639 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:27.711847 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c18ede5-cb6e-4d4f-812f-54e4c8193639 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:27.712752 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c18ede5-cb6e-4d4f-812f-54e4c8193639 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:27.805365 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5c18ede5-cb6e-4d4f-812f-54e4c8193639 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.109934 Nov 11 20:39:27.806315 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 98/192] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:27 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:28.687714 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8f2cce98-5189-469c-82b3-0fab8d6ae122 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:28.688571 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8f2cce98-5189-469c-82b3-0fab8d6ae122 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:28.700640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8f2cce98-5189-469c-82b3-0fab8d6ae122 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:28.701040 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8f2cce98-5189-469c-82b3-0fab8d6ae122 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:28.701842 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8f2cce98-5189-469c-82b3-0fab8d6ae122 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:28.702280 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8f2cce98-5189-469c-82b3-0fab8d6ae122 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:28.704331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d4cf6416-d3cf-4f9b-9792-8a2ad575b3c7 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:28.707747 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d4cf6416-d3cf-4f9b-9792-8a2ad575b3c7 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:28.730968 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d4cf6416-d3cf-4f9b-9792-8a2ad575b3c7 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:28.731670 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d4cf6416-d3cf-4f9b-9792-8a2ad575b3c7 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:28.732727 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d4cf6416-d3cf-4f9b-9792-8a2ad575b3c7 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:28.733165 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d4cf6416-d3cf-4f9b-9792-8a2ad575b3c7 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:28.960791 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-8f2cce98-5189-469c-82b3-0fab8d6ae122 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:28.972411 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8f2cce98-5189-469c-82b3-0fab8d6ae122 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.288214 Nov 11 20:39:28.973557 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 95/193] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:28 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:28.990021 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7152d2d8-aa54-4e8f-80f1-809693791085 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:28.991042 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7152d2d8-aa54-4e8f-80f1-809693791085 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:28.996140 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d4cf6416-d3cf-4f9b-9792-8a2ad575b3c7 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:29.002705 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7152d2d8-aa54-4e8f-80f1-809693791085 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:29.003348 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7152d2d8-aa54-4e8f-80f1-809693791085 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:29.004596 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7152d2d8-aa54-4e8f-80f1-809693791085 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:29.006204 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7152d2d8-aa54-4e8f-80f1-809693791085 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:29.008500 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d4cf6416-d3cf-4f9b-9792-8a2ad575b3c7 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1553 microversion: 2.1 time: 0.309403 Nov 11 20:39:29.009799 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 99/194] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:28 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:29.130047 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7152d2d8-aa54-4e8f-80f1-809693791085 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.153429 Nov 11 20:39:29.132332 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 96/195] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:28 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:29.993881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b7569e52-d12c-4bc4-af83-0724d059297e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:29.994490 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b7569e52-d12c-4bc4-af83-0724d059297e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:30.011802 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b7569e52-d12c-4bc4-af83-0724d059297e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:30.012281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b7569e52-d12c-4bc4-af83-0724d059297e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:30.013072 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b7569e52-d12c-4bc4-af83-0724d059297e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:30.016520 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b7569e52-d12c-4bc4-af83-0724d059297e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:30.026790 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-545a89c5-fc69-4dfc-a204-3e0258295991 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:30.027568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-545a89c5-fc69-4dfc-a204-3e0258295991 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:30.044238 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-545a89c5-fc69-4dfc-a204-3e0258295991 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:30.044700 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-545a89c5-fc69-4dfc-a204-3e0258295991 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:30.045502 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-545a89c5-fc69-4dfc-a204-3e0258295991 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:30.045939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-545a89c5-fc69-4dfc-a204-3e0258295991 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:30.483476 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-545a89c5-fc69-4dfc-a204-3e0258295991 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:30.501022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b7569e52-d12c-4bc4-af83-0724d059297e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:30.509403 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b7569e52-d12c-4bc4-af83-0724d059297e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.523932 Nov 11 20:39:30.512988 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 100/196] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:29 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:30.525778 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ef748f3c-37dc-49c4-9072-b2c657a8ec89 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:30.526959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ef748f3c-37dc-49c4-9072-b2c657a8ec89 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:30.527599 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-545a89c5-fc69-4dfc-a204-3e0258295991 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1553 microversion: 2.1 time: 0.504749 Nov 11 20:39:30.530378 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 97/197] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:30 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1553 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:30.542046 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ef748f3c-37dc-49c4-9072-b2c657a8ec89 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:30.542489 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ef748f3c-37dc-49c4-9072-b2c657a8ec89 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:30.543275 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ef748f3c-37dc-49c4-9072-b2c657a8ec89 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:30.543697 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ef748f3c-37dc-49c4-9072-b2c657a8ec89 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:30.653989 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ef748f3c-37dc-49c4-9072-b2c657a8ec89 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.139608 Nov 11 20:39:30.654622 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 101/198] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:30 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:31.004364 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-286bb504-1bbd-44f0-b2b7-0b7e507ce1c4 req-aa20f64a-755d-4349-ad66-ec4b3f7af5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b182b81-371c-4244-b016-dffa07121ef2", "name": "network-vif-deleted", "tag": "90ad1ea9-d70f-404f-aa76-239fd7557f37"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:31.005906 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:39:31.005906 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:39:31.027380 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-286bb504-1bbd-44f0-b2b7-0b7e507ce1c4 req-aa20f64a-755d-4349-ad66-ec4b3f7af5e5 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:31.028651 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-286bb504-1bbd-44f0-b2b7-0b7e507ce1c4 req-aa20f64a-755d-4349-ad66-ec4b3f7af5e5 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:31.068949 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-286bb504-1bbd-44f0-b2b7-0b7e507ce1c4 req-aa20f64a-755d-4349-ad66-ec4b3f7af5e5 service nova] Creating event network-vif-deleted:90ad1ea9-d70f-404f-aa76-239fd7557f37 for instance 4b182b81-371c-4244-b016-dffa07121ef2 on hv-cinder-81764 Nov 11 20:39:31.071521 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-286bb504-1bbd-44f0-b2b7-0b7e507ce1c4 req-aa20f64a-755d-4349-ad66-ec4b3f7af5e5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079619 Nov 11 20:39:31.072154 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 98/199] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:39:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:39:31.532334 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e1056d33-fd09-42d6-888e-d21aeff22150 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:31.538061 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e1056d33-fd09-42d6-888e-d21aeff22150 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:31.545365 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-df386f4c-7726-48b2-a5d3-c0060e770f5f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:31.546082 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-df386f4c-7726-48b2-a5d3-c0060e770f5f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:31.549552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e1056d33-fd09-42d6-888e-d21aeff22150 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:31.550031 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e1056d33-fd09-42d6-888e-d21aeff22150 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:31.551539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e1056d33-fd09-42d6-888e-d21aeff22150 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:31.556466 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-df386f4c-7726-48b2-a5d3-c0060e770f5f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:31.556913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-df386f4c-7726-48b2-a5d3-c0060e770f5f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:31.557617 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e1056d33-fd09-42d6-888e-d21aeff22150 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:31.557728 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-df386f4c-7726-48b2-a5d3-c0060e770f5f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:31.558123 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-df386f4c-7726-48b2-a5d3-c0060e770f5f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:31.717987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-df386f4c-7726-48b2-a5d3-c0060e770f5f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42b900060b74a14b00e53b51393dbb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daea5c9b8ea4f91b977e9e3cd28c055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:31.743887 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-df386f4c-7726-48b2-a5d3-c0060e770f5f tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 200 len: 1346 microversion: 2.1 time: 0.202013 Nov 11 20:39:31.748762 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 99/200] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:31 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 1346 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:31.754247 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ce402cab-af38-4985-9962-38e210697cd6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:31.757991 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ce402cab-af38-4985-9962-38e210697cd6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:31.775369 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce402cab-af38-4985-9962-38e210697cd6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:31.776658 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce402cab-af38-4985-9962-38e210697cd6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:31.777498 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce402cab-af38-4985-9962-38e210697cd6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:31.777936 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce402cab-af38-4985-9962-38e210697cd6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:31.840825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e1056d33-fd09-42d6-888e-d21aeff22150 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:31.855179 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e1056d33-fd09-42d6-888e-d21aeff22150 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.326756 Nov 11 20:39:31.867274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 102/201] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:31 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:31.931698 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ce402cab-af38-4985-9962-38e210697cd6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.181012 Nov 11 20:39:31.932784 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 100/202] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:31 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:32.763298 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-61ec0bb7-aae9-47a2-9118-54f0c24037a5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:32.763930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-61ec0bb7-aae9-47a2-9118-54f0c24037a5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:32.777177 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61ec0bb7-aae9-47a2-9118-54f0c24037a5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:32.777653 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61ec0bb7-aae9-47a2-9118-54f0c24037a5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:32.779625 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61ec0bb7-aae9-47a2-9118-54f0c24037a5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:32.780122 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61ec0bb7-aae9-47a2-9118-54f0c24037a5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:32.822045 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-61ec0bb7-aae9-47a2-9118-54f0c24037a5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] HTTP exception thrown: Instance 4b182b81-371c-4244-b016-dffa07121ef2 could not be found. Nov 11 20:39:32.823083 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-61ec0bb7-aae9-47a2-9118-54f0c24037a5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Returning 404 to user: Instance 4b182b81-371c-4244-b016-dffa07121ef2 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:39:32.824432 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-61ec0bb7-aae9-47a2-9118-54f0c24037a5 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 404 len: 111 microversion: 2.1 time: 0.065429 Nov 11 20:39:32.825115 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 103/203] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:32 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:39:32.874173 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-718b1f8a-8e43-4121-8437-e7bd325bc50d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:32.875006 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-718b1f8a-8e43-4121-8437-e7bd325bc50d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:32.886454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-718b1f8a-8e43-4121-8437-e7bd325bc50d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:32.886917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-718b1f8a-8e43-4121-8437-e7bd325bc50d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:32.887727 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-718b1f8a-8e43-4121-8437-e7bd325bc50d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:32.888204 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-718b1f8a-8e43-4121-8437-e7bd325bc50d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:32.950111 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-af5fc780-9ac9-4064-abc7-06bd25a0a7e4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:32.960278 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-af5fc780-9ac9-4064-abc7-06bd25a0a7e4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:32.968703 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af5fc780-9ac9-4064-abc7-06bd25a0a7e4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:32.970422 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af5fc780-9ac9-4064-abc7-06bd25a0a7e4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:32.971216 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af5fc780-9ac9-4064-abc7-06bd25a0a7e4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:32.972516 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af5fc780-9ac9-4064-abc7-06bd25a0a7e4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:33.123000 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-af5fc780-9ac9-4064-abc7-06bd25a0a7e4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.183911 Nov 11 20:39:33.126922 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 104/204] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:32 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:33.138172 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5fa5ae04-7ff6-4f3a-bca9-e1003046062c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:33.139399 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5fa5ae04-7ff6-4f3a-bca9-e1003046062c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:33.154480 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5fa5ae04-7ff6-4f3a-bca9-e1003046062c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:33.162396 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-718b1f8a-8e43-4121-8437-e7bd325bc50d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:33.166430 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5fa5ae04-7ff6-4f3a-bca9-e1003046062c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:33.170876 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-718b1f8a-8e43-4121-8437-e7bd325bc50d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.300827 Nov 11 20:39:33.171901 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5fa5ae04-7ff6-4f3a-bca9-e1003046062c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:33.173291 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5fa5ae04-7ff6-4f3a-bca9-e1003046062c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:33.174053 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 101/205] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:32 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:33.208759 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-5fa5ae04-7ff6-4f3a-bca9-e1003046062c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] HTTP exception thrown: Instance 4b182b81-371c-4244-b016-dffa07121ef2 could not be found. Nov 11 20:39:33.209293 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5fa5ae04-7ff6-4f3a-bca9-e1003046062c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Returning 404 to user: Instance 4b182b81-371c-4244-b016-dffa07121ef2 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:39:33.210134 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5fa5ae04-7ff6-4f3a-bca9-e1003046062c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.081781 Nov 11 20:39:33.210689 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 105/206] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:39:33 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2/os-volume_attachments => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:39:33.415388 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1498331643", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "networks": [{"uuid": "f75b74a3-4944-4e66-a1f1-0eb754745d66"}]}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:34.136927 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ba021843-7d54-408c-a744-0f183a264320 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:34.138159 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ba021843-7d54-408c-a744-0f183a264320 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:34.144997 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ba021843-7d54-408c-a744-0f183a264320 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:34.145812 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ba021843-7d54-408c-a744-0f183a264320 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:34.146596 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ba021843-7d54-408c-a744-0f183a264320 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:34.147306 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ba021843-7d54-408c-a744-0f183a264320 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:34.248389 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ba021843-7d54-408c-a744-0f183a264320 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.115196 Nov 11 20:39:34.249154 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 106/207] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:34 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:34.254269 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f83b7af9-120f-4ba1-a049-056231525b66 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:34.255157 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f83b7af9-120f-4ba1-a049-056231525b66 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:34.265413 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f83b7af9-120f-4ba1-a049-056231525b66 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:34.265856 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f83b7af9-120f-4ba1-a049-056231525b66 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:34.266682 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f83b7af9-120f-4ba1-a049-056231525b66 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:34.267116 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f83b7af9-120f-4ba1-a049-056231525b66 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:34.523373 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f83b7af9-120f-4ba1-a049-056231525b66 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:34.530903 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f83b7af9-120f-4ba1-a049-056231525b66 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.280566 Nov 11 20:39:34.531486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 107/208] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:34 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:34.578157 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-17806964-ecec-47ce-93c1-d7e72243fcb0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:34.580485 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-17806964-ecec-47ce-93c1-d7e72243fcb0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:34.590224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-17806964-ecec-47ce-93c1-d7e72243fcb0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:34.592024 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-17806964-ecec-47ce-93c1-d7e72243fcb0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:34.592024 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-17806964-ecec-47ce-93c1-d7e72243fcb0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:34.592024 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-17806964-ecec-47ce-93c1-d7e72243fcb0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:34.608347 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-17806964-ecec-47ce-93c1-d7e72243fcb0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] HTTP exception thrown: Instance 4b182b81-371c-4244-b016-dffa07121ef2 could not be found. Nov 11 20:39:34.609818 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-17806964-ecec-47ce-93c1-d7e72243fcb0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Returning 404 to user: Instance 4b182b81-371c-4244-b016-dffa07121ef2 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:39:34.610823 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-17806964-ecec-47ce-93c1-d7e72243fcb0 tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 404 len: 111 microversion: 2.1 time: 0.051277 Nov 11 20:39:34.617234 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 108/209] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:39:34 2021] DELETE /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 11 20:39:34.622347 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b8a9687d-b38c-4db0-abf2-186ad18ebb2c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:34.623147 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b8a9687d-b38c-4db0-abf2-186ad18ebb2c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] [instance: 4b182b81-371c-4244-b016-dffa07121ef2] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:34.629810 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b8a9687d-b38c-4db0-abf2-186ad18ebb2c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:34.630486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b8a9687d-b38c-4db0-abf2-186ad18ebb2c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:34.631563 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b8a9687d-b38c-4db0-abf2-186ad18ebb2c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:34.632218 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b8a9687d-b38c-4db0-abf2-186ad18ebb2c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:34.656251 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-b8a9687d-b38c-4db0-abf2-186ad18ebb2c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] HTTP exception thrown: Instance 4b182b81-371c-4244-b016-dffa07121ef2 could not be found. Nov 11 20:39:34.656961 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b8a9687d-b38c-4db0-abf2-186ad18ebb2c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] Returning 404 to user: Instance 4b182b81-371c-4244-b016-dffa07121ef2 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:39:34.660063 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b8a9687d-b38c-4db0-abf2-186ad18ebb2c tempest-DeleteServersTestJSON-1788446717 tempest-DeleteServersTestJSON-1788446717-project] 10.222.0.61 "GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2" status: 404 len: 111 microversion: 2.1 time: 0.041631 Nov 11 20:39:34.661661 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 109/210] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:34 2021] GET /compute/v2.1/servers/4b182b81-371c-4244-b016-dffa07121ef2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:39:35.259840 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5a6a9fe7-2b79-4108-9a5b-6ec4b65b8de8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:35.262775 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5a6a9fe7-2b79-4108-9a5b-6ec4b65b8de8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:35.280806 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5a6a9fe7-2b79-4108-9a5b-6ec4b65b8de8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:35.281548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5a6a9fe7-2b79-4108-9a5b-6ec4b65b8de8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:35.282471 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5a6a9fe7-2b79-4108-9a5b-6ec4b65b8de8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:35.288414 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5a6a9fe7-2b79-4108-9a5b-6ec4b65b8de8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:35.410391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5a6a9fe7-2b79-4108-9a5b-6ec4b65b8de8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.154354 Nov 11 20:39:35.412045 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 110/211] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:35 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:35.553287 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-983a706a-b6a8-4bef-9fed-920b9f90c910 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:35.554021 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-983a706a-b6a8-4bef-9fed-920b9f90c910 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:35.567624 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-983a706a-b6a8-4bef-9fed-920b9f90c910 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:35.568807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-983a706a-b6a8-4bef-9fed-920b9f90c910 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:35.569888 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-983a706a-b6a8-4bef-9fed-920b9f90c910 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:35.572619 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-983a706a-b6a8-4bef-9fed-920b9f90c910 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:35.804246 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-983a706a-b6a8-4bef-9fed-920b9f90c910 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:35.829083 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-983a706a-b6a8-4bef-9fed-920b9f90c910 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.281287 Nov 11 20:39:35.829669 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 111/212] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:35 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:35.893305 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2ce9f296-ce90-45fd-be2a-0ef959a16a56 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Action: 'create', calling method: .version_select at 0x7ff3ee4969d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2023468667"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:35.921474 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-2ce9f296-ce90-45fd-be2a-0ef959a16a56 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Getting quotas for project 4f3da3f794f742c0a5bf009d5bad5208. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:39:35.924847 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.network.neutron [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] validate_networks() for [('f75b74a3-4944-4e66-a1f1-0eb754745d66', None, None, None, None, None)] {{(pid=122527) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:39:35.930429 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-2ce9f296-ce90-45fd-be2a-0ef959a16a56 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Getting quotas for user 0b806e1d785746d8b429046c3d6e41f8 and project 4f3da3f794f742c0a5bf009d5bad5208. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:39:36.296922 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-2ce9f296-ce90-45fd-be2a-0ef959a16a56 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Getting quotas for project 4f3da3f794f742c0a5bf009d5bad5208. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:39:36.300989 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-2ce9f296-ce90-45fd-be2a-0ef959a16a56 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Getting quotas for user 0b806e1d785746d8b429046c3d6e41f8 and project 4f3da3f794f742c0a5bf009d5bad5208. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:39:36.314931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2ce9f296-ce90-45fd-be2a-0ef959a16a56 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.425715 Nov 11 20:39:36.328218 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 112/213] 10.222.0.61 () {60 vars in 1157 bytes} [Thu Nov 11 20:39:35 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:36.424903 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-40a7ff01-d4a0-4c73-83d6-deee39ea0979 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:36.425876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-40a7ff01-d4a0-4c73-83d6-deee39ea0979 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:36.434145 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-40a7ff01-d4a0-4c73-83d6-deee39ea0979 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:36.434850 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-40a7ff01-d4a0-4c73-83d6-deee39ea0979 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:36.435840 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-40a7ff01-d4a0-4c73-83d6-deee39ea0979 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:36.436495 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-40a7ff01-d4a0-4c73-83d6-deee39ea0979 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:36.502202 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Flavor limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:39:36.502767 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Image limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:39:36.503172 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Flavor pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:39:36.503583 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Image pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:39:36.505765 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:39:36.517048 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:36.517497 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:36.518364 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:36.518799 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:36.537293 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Getting quotas for project 7b92a8a05c22447985ae53c7b9c91fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:39:36.541269 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Getting quotas for user f77c253d448e482db5ecbc453e4e0f3e and project 7b92a8a05c22447985ae53c7b9c91fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:39:36.544851 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-40a7ff01-d4a0-4c73-83d6-deee39ea0979 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.126137 Nov 11 20:39:36.549052 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 113/214] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:36 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:36.555554 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Going to run 1 instances... {{(pid=122527) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:39:36.558227 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:39:36.562180 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-928866190", "imageRef": "fa827c8f-ebf1-4ab4-b977-093e3bfe0ef0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2023468667", "networks": [{"uuid": "e3ad6302-2af8-4f34-932c-43eafe0c8fe6"}]}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:36.612164 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f340b012-bb21-434f-8755-a0116447840b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.205345 Nov 11 20:39:36.612894 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 102/215] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:39:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 3207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 11 20:39:36.623194 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-48c3fb87-239c-4371-a19f-f4a83f50fc96 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:36.624005 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-48c3fb87-239c-4371-a19f-f4a83f50fc96 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:36.646510 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.network.neutron [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] validate_networks() for [('e3ad6302-2af8-4f34-932c-43eafe0c8fe6', None, None, None, None, None)] {{(pid=122526) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:39:36.729223 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-48c3fb87-239c-4371-a19f-f4a83f50fc96 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:36.740726 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-48c3fb87-239c-4371-a19f-f4a83f50fc96 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1218 microversion: 2.1 time: 0.121158 Nov 11 20:39:36.741380 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 103/216] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:36 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:36.846905 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-af75cbc1-dd8a-4127-97f7-a00aa46bf6c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:36.847955 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-af75cbc1-dd8a-4127-97f7-a00aa46bf6c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:36.855652 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-af75cbc1-dd8a-4127-97f7-a00aa46bf6c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:36.856380 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-af75cbc1-dd8a-4127-97f7-a00aa46bf6c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:36.857555 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-af75cbc1-dd8a-4127-97f7-a00aa46bf6c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:36.858204 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-af75cbc1-dd8a-4127-97f7-a00aa46bf6c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:37.137848 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-af75cbc1-dd8a-4127-97f7-a00aa46bf6c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:37.152540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-af75cbc1-dd8a-4127-97f7-a00aa46bf6c2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.308911 Nov 11 20:39:37.155060 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 104/217] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:36 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:37.316510 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Flavor limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:39:37.317170 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Image limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:39:37.317755 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Flavor pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:39:37.318583 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Image pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:39:37.318998 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:39:37.330499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:37.331145 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:37.331997 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:37.333072 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:37.356489 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Getting quotas for project 4f3da3f794f742c0a5bf009d5bad5208. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:39:37.361607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Getting quotas for user 0b806e1d785746d8b429046c3d6e41f8 and project 4f3da3f794f742c0a5bf009d5bad5208. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:39:37.378487 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Going to run 1 instances... {{(pid=122526) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:39:37.381360 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa827c8f-ebf1-4ab4-b977-093e3bfe0ef0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:39:37.439834 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-97ffa638-9d35-4243-bcde-ffb510af2c72 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888962 Nov 11 20:39:37.440681 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 114/218] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:39:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:39:37.453251 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4dca9d12-d4b9-49ce-b9bd-b675d4f1f536 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:37.454207 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4dca9d12-d4b9-49ce-b9bd-b675d4f1f536 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:37.526264 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-4dca9d12-d4b9-49ce-b9bd-b675d4f1f536 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:37.534460 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4dca9d12-d4b9-49ce-b9bd-b675d4f1f536 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1258 microversion: 2.1 time: 0.086513 Nov 11 20:39:37.535140 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 105/219] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:37 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1258 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:37.557833 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-23629776-1d3b-4e6d-90f0-c7726024eec6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:37.559034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-23629776-1d3b-4e6d-90f0-c7726024eec6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:37.566236 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-23629776-1d3b-4e6d-90f0-c7726024eec6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:37.567097 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-23629776-1d3b-4e6d-90f0-c7726024eec6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:37.568696 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-23629776-1d3b-4e6d-90f0-c7726024eec6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:37.569352 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-23629776-1d3b-4e6d-90f0-c7726024eec6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:37.709299 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-23629776-1d3b-4e6d-90f0-c7726024eec6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.156312 Nov 11 20:39:37.710080 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 115/220] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:37 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:37.761113 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a40db577-b18f-4f94-84f9-f95d913521b1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:37.762284 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a40db577-b18f-4f94-84f9-f95d913521b1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:37.774407 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a40db577-b18f-4f94-84f9-f95d913521b1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:37.774859 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a40db577-b18f-4f94-84f9-f95d913521b1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:37.775655 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a40db577-b18f-4f94-84f9-f95d913521b1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:37.776169 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a40db577-b18f-4f94-84f9-f95d913521b1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:37.848270 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a40db577-b18f-4f94-84f9-f95d913521b1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:37.860940 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a40db577-b18f-4f94-84f9-f95d913521b1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1270 microversion: 2.1 time: 0.100743 Nov 11 20:39:37.863028 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 106/221] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:37 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:38.172328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6629af78-a173-47e5-916d-698a51dda2f3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:38.173973 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6629af78-a173-47e5-916d-698a51dda2f3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:38.182473 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6629af78-a173-47e5-916d-698a51dda2f3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:38.183267 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6629af78-a173-47e5-916d-698a51dda2f3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:38.184263 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6629af78-a173-47e5-916d-698a51dda2f3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:38.184847 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6629af78-a173-47e5-916d-698a51dda2f3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:38.388063 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6629af78-a173-47e5-916d-698a51dda2f3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:38.400277 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6629af78-a173-47e5-916d-698a51dda2f3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.231001 Nov 11 20:39:38.401901 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 116/222] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:38 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:38.552339 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-aee9a60a-0af9-4cdd-a193-92c0a17b5ba0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:38.553789 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-aee9a60a-0af9-4cdd-a193-92c0a17b5ba0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:38.563770 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aee9a60a-0af9-4cdd-a193-92c0a17b5ba0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:38.567280 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aee9a60a-0af9-4cdd-a193-92c0a17b5ba0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:38.568227 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aee9a60a-0af9-4cdd-a193-92c0a17b5ba0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:38.572410 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aee9a60a-0af9-4cdd-a193-92c0a17b5ba0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:38.721504 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-aee9a60a-0af9-4cdd-a193-92c0a17b5ba0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:38.725198 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-96e753c7-56dd-47e5-8ede-022a6e556f10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:38.728000 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-96e753c7-56dd-47e5-8ede-022a6e556f10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:38.739797 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-96e753c7-56dd-47e5-8ede-022a6e556f10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:38.742436 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-aee9a60a-0af9-4cdd-a193-92c0a17b5ba0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1310 microversion: 2.1 time: 0.187319 Nov 11 20:39:38.743260 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 107/223] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:38 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1310 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:38.747898 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-96e753c7-56dd-47e5-8ede-022a6e556f10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:38.748922 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-96e753c7-56dd-47e5-8ede-022a6e556f10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:38.749368 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-96e753c7-56dd-47e5-8ede-022a6e556f10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:38.860626 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-96e753c7-56dd-47e5-8ede-022a6e556f10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.144249 Nov 11 20:39:38.861684 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 117/224] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:38 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:38.878547 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5683d137-d7ce-47c6-8bd7-9f5af6c64f09 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:38.879765 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5683d137-d7ce-47c6-8bd7-9f5af6c64f09 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:38.889432 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5683d137-d7ce-47c6-8bd7-9f5af6c64f09 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:38.890499 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5683d137-d7ce-47c6-8bd7-9f5af6c64f09 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:38.893489 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5683d137-d7ce-47c6-8bd7-9f5af6c64f09 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:38.893940 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5683d137-d7ce-47c6-8bd7-9f5af6c64f09 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:38.994407 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5683d137-d7ce-47c6-8bd7-9f5af6c64f09 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:39.006425 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5683d137-d7ce-47c6-8bd7-9f5af6c64f09 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1276 microversion: 2.1 time: 0.131658 Nov 11 20:39:39.008557 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 108/225] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:38 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:39.421737 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b8cd13f1-a048-4293-980d-6f715cc5d862 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:39.422435 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b8cd13f1-a048-4293-980d-6f715cc5d862 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:39.431286 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b8cd13f1-a048-4293-980d-6f715cc5d862 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:39.435605 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b8cd13f1-a048-4293-980d-6f715cc5d862 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:39.438433 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b8cd13f1-a048-4293-980d-6f715cc5d862 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:39.440378 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b8cd13f1-a048-4293-980d-6f715cc5d862 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:39.761126 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-04983f1d-04fa-44a3-b842-5dbc26f994f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:39.761722 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-04983f1d-04fa-44a3-b842-5dbc26f994f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:39.778083 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-04983f1d-04fa-44a3-b842-5dbc26f994f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:39.778758 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-04983f1d-04fa-44a3-b842-5dbc26f994f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:39.779721 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-04983f1d-04fa-44a3-b842-5dbc26f994f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:39.780351 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-04983f1d-04fa-44a3-b842-5dbc26f994f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:40.048162 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-04983f1d-04fa-44a3-b842-5dbc26f994f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:40.066456 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-04983f1d-04fa-44a3-b842-5dbc26f994f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1316 microversion: 2.1 time: 0.307886 Nov 11 20:39:40.072643 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 109/226] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:39 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:40.094033 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c8ecbc36-a316-4d59-b88c-fc1554d3c5d9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:40.097605 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c8ecbc36-a316-4d59-b88c-fc1554d3c5d9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:40.117374 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c8ecbc36-a316-4d59-b88c-fc1554d3c5d9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:40.118392 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c8ecbc36-a316-4d59-b88c-fc1554d3c5d9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:40.119937 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c8ecbc36-a316-4d59-b88c-fc1554d3c5d9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:40.120698 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c8ecbc36-a316-4d59-b88c-fc1554d3c5d9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:40.249812 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c8ecbc36-a316-4d59-b88c-fc1554d3c5d9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 14 microversion: 2.20 time: 0.175254 Nov 11 20:39:40.250931 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 110/227] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:40 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:40.257513 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5e853426-5cfa-498c-a6c7-ebcc09924aa2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:40.259416 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5e853426-5cfa-498c-a6c7-ebcc09924aa2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:40.272475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5e853426-5cfa-498c-a6c7-ebcc09924aa2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:40.272917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5e853426-5cfa-498c-a6c7-ebcc09924aa2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:40.273708 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5e853426-5cfa-498c-a6c7-ebcc09924aa2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:40.277593 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5e853426-5cfa-498c-a6c7-ebcc09924aa2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:40.582147 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b8cd13f1-a048-4293-980d-6f715cc5d862 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:40.595099 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b8cd13f1-a048-4293-980d-6f715cc5d862 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 1.177480 Nov 11 20:39:40.606451 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 118/228] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:39 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:41.092968 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5cda00d3-6d21-4160-809b-f44a62ea9303 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:41.093587 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5cda00d3-6d21-4160-809b-f44a62ea9303 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:41.115615 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5cda00d3-6d21-4160-809b-f44a62ea9303 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:41.116105 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5cda00d3-6d21-4160-809b-f44a62ea9303 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:41.120611 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5cda00d3-6d21-4160-809b-f44a62ea9303 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:41.121657 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5cda00d3-6d21-4160-809b-f44a62ea9303 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:41.273917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5e853426-5cfa-498c-a6c7-ebcc09924aa2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:41.295239 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5e853426-5cfa-498c-a6c7-ebcc09924aa2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 1.041615 Nov 11 20:39:41.311807 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 111/229] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:40 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:41.317578 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5cda00d3-6d21-4160-809b-f44a62ea9303 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:41.327661 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5cda00d3-6d21-4160-809b-f44a62ea9303 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1316 microversion: 2.1 time: 0.240438 Nov 11 20:39:41.334806 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d9e480cf-3f85-4a59-b95b-b992d1e10396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:41.340575 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d9e480cf-3f85-4a59-b95b-b992d1e10396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:41.347269 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 119/230] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:41 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:41.350156 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d9e480cf-3f85-4a59-b95b-b992d1e10396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:41.350854 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d9e480cf-3f85-4a59-b95b-b992d1e10396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:41.351886 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d9e480cf-3f85-4a59-b95b-b992d1e10396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:41.352553 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d9e480cf-3f85-4a59-b95b-b992d1e10396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:41.611966 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f63e38a3-1590-404d-be39-fdb23b98fe30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:41.612592 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f63e38a3-1590-404d-be39-fdb23b98fe30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:41.625536 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f63e38a3-1590-404d-be39-fdb23b98fe30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:41.625982 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f63e38a3-1590-404d-be39-fdb23b98fe30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:41.632497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f63e38a3-1590-404d-be39-fdb23b98fe30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:41.632947 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f63e38a3-1590-404d-be39-fdb23b98fe30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:42.245261 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f63e38a3-1590-404d-be39-fdb23b98fe30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:42.261813 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f63e38a3-1590-404d-be39-fdb23b98fe30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.653501 Nov 11 20:39:42.263498 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 120/231] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:41 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:42.318507 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-17ed04b2-551f-4ddf-8402-e71e4afc4468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:42.320192 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-17ed04b2-551f-4ddf-8402-e71e4afc4468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:42.344319 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-17ed04b2-551f-4ddf-8402-e71e4afc4468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:42.345120 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-17ed04b2-551f-4ddf-8402-e71e4afc4468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:42.346124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-17ed04b2-551f-4ddf-8402-e71e4afc4468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:42.346798 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-17ed04b2-551f-4ddf-8402-e71e4afc4468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:42.909600 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-17ed04b2-551f-4ddf-8402-e71e4afc4468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:42.930152 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-17ed04b2-551f-4ddf-8402-e71e4afc4468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.620634 Nov 11 20:39:42.936659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 121/232] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:42 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:42.950672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ebdb9ed6-9382-4b6b-9d74-5654ac8d31cd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:42.951559 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ebdb9ed6-9382-4b6b-9d74-5654ac8d31cd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:42.966089 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ebdb9ed6-9382-4b6b-9d74-5654ac8d31cd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:42.970597 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ebdb9ed6-9382-4b6b-9d74-5654ac8d31cd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:42.974269 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ebdb9ed6-9382-4b6b-9d74-5654ac8d31cd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:42.975044 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ebdb9ed6-9382-4b6b-9d74-5654ac8d31cd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:43.620150 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ebdb9ed6-9382-4b6b-9d74-5654ac8d31cd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:43.630029 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ebdb9ed6-9382-4b6b-9d74-5654ac8d31cd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.691006 Nov 11 20:39:43.630698 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 122/233] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:42 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:43.635915 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6aaf0fc2-3a01-401a-9b05-a61c5a9bd30d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:43.636870 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6aaf0fc2-3a01-401a-9b05-a61c5a9bd30d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:43.644285 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6aaf0fc2-3a01-401a-9b05-a61c5a9bd30d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:43.645672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6aaf0fc2-3a01-401a-9b05-a61c5a9bd30d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:43.646524 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6aaf0fc2-3a01-401a-9b05-a61c5a9bd30d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:43.646888 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6aaf0fc2-3a01-401a-9b05-a61c5a9bd30d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:43.994175 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6aaf0fc2-3a01-401a-9b05-a61c5a9bd30d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:44.003292 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6aaf0fc2-3a01-401a-9b05-a61c5a9bd30d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.371264 Nov 11 20:39:44.007246 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 123/234] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:43 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:44.020420 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-1452ff00-b663-4e38-9505-ef5468e7989a req-dcc4b391-d12e-49ae-b5a6-2a1bb4174cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bded2955-e01c-44b7-8296-944f839f06b9", "tag": "29fa7464-b08b-4f56-89c0-b86091d4eb50"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:44.022816 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:39:44.022816 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:39:44.033083 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-1452ff00-b663-4e38-9505-ef5468e7989a req-dcc4b391-d12e-49ae-b5a6-2a1bb4174cb3 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:44.033497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-1452ff00-b663-4e38-9505-ef5468e7989a req-dcc4b391-d12e-49ae-b5a6-2a1bb4174cb3 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:44.049338 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-1452ff00-b663-4e38-9505-ef5468e7989a req-dcc4b391-d12e-49ae-b5a6-2a1bb4174cb3 service nova] Creating event network-changed:29fa7464-b08b-4f56-89c0-b86091d4eb50 for instance bded2955-e01c-44b7-8296-944f839f06b9 on hv-cinder-81764 Nov 11 20:39:44.055858 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-1452ff00-b663-4e38-9505-ef5468e7989a req-dcc4b391-d12e-49ae-b5a6-2a1bb4174cb3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047175 Nov 11 20:39:44.056805 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 124/235] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:39:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:39:44.061977 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9ed75fe8-b404-4085-82a5-5ac044df4b86 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:44.062664 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9ed75fe8-b404-4085-82a5-5ac044df4b86 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:44.070337 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9ed75fe8-b404-4085-82a5-5ac044df4b86 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:44.071050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9ed75fe8-b404-4085-82a5-5ac044df4b86 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:44.073393 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9ed75fe8-b404-4085-82a5-5ac044df4b86 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:44.074147 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9ed75fe8-b404-4085-82a5-5ac044df4b86 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:44.266126 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9ed75fe8-b404-4085-82a5-5ac044df4b86 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:44.280760 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9ed75fe8-b404-4085-82a5-5ac044df4b86 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.222004 Nov 11 20:39:44.283700 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 125/236] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:44 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:44.647627 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-63b000d1-b376-4293-a4fe-1d224a91578e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:44.648321 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-63b000d1-b376-4293-a4fe-1d224a91578e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:44.655003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-63b000d1-b376-4293-a4fe-1d224a91578e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:44.655461 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-63b000d1-b376-4293-a4fe-1d224a91578e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:44.656503 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-63b000d1-b376-4293-a4fe-1d224a91578e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:44.656939 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-63b000d1-b376-4293-a4fe-1d224a91578e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:44.837912 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-63b000d1-b376-4293-a4fe-1d224a91578e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:44.850692 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-63b000d1-b376-4293-a4fe-1d224a91578e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.206213 Nov 11 20:39:44.853880 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 126/237] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:44 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:45.023792 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-11bbf177-4029-486f-b904-252df9007dc8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:45.025131 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-11bbf177-4029-486f-b904-252df9007dc8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:45.037424 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11bbf177-4029-486f-b904-252df9007dc8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:45.040691 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11bbf177-4029-486f-b904-252df9007dc8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:45.041733 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11bbf177-4029-486f-b904-252df9007dc8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:45.044277 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11bbf177-4029-486f-b904-252df9007dc8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:45.295521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-11bbf177-4029-486f-b904-252df9007dc8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:45.324477 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-11bbf177-4029-486f-b904-252df9007dc8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.301219 Nov 11 20:39:45.336168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 127/238] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:45 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:45.344314 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c269a9d0-b04b-4054-861a-ffa370811b08 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:45.344937 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c269a9d0-b04b-4054-861a-ffa370811b08 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:45.353397 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c269a9d0-b04b-4054-861a-ffa370811b08 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:45.353858 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c269a9d0-b04b-4054-861a-ffa370811b08 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:45.354666 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c269a9d0-b04b-4054-861a-ffa370811b08 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:45.355110 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c269a9d0-b04b-4054-861a-ffa370811b08 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:45.561049 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c269a9d0-b04b-4054-861a-ffa370811b08 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:45.571522 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c269a9d0-b04b-4054-861a-ffa370811b08 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.234193 Nov 11 20:39:45.572458 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 128/239] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:45 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:45.870900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8cabb35b-ac56-4943-a2c5-9620ff56e542 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:45.871584 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8cabb35b-ac56-4943-a2c5-9620ff56e542 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:45.886250 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8cabb35b-ac56-4943-a2c5-9620ff56e542 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:45.896723 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8cabb35b-ac56-4943-a2c5-9620ff56e542 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:45.898160 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8cabb35b-ac56-4943-a2c5-9620ff56e542 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:45.898873 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8cabb35b-ac56-4943-a2c5-9620ff56e542 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:46.127738 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8cabb35b-ac56-4943-a2c5-9620ff56e542 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:46.135593 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8cabb35b-ac56-4943-a2c5-9620ff56e542 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.268343 Nov 11 20:39:46.136196 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 129/240] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:45 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:46.345714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b585ab3d-d335-41ec-bd8a-c03933c3832b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:46.346491 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b585ab3d-d335-41ec-bd8a-c03933c3832b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:46.362332 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b585ab3d-d335-41ec-bd8a-c03933c3832b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:46.364589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b585ab3d-d335-41ec-bd8a-c03933c3832b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:46.369055 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b585ab3d-d335-41ec-bd8a-c03933c3832b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:46.369718 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b585ab3d-d335-41ec-bd8a-c03933c3832b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:46.591138 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b585ab3d-d335-41ec-bd8a-c03933c3832b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:46.610933 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b585ab3d-d335-41ec-bd8a-c03933c3832b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.270396 Nov 11 20:39:46.611745 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 130/241] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:46 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:46.622526 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-53124e3c-f7d1-4410-87a6-b8aa1bca897a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:46.623140 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-53124e3c-f7d1-4410-87a6-b8aa1bca897a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:46.630122 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53124e3c-f7d1-4410-87a6-b8aa1bca897a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:46.630603 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53124e3c-f7d1-4410-87a6-b8aa1bca897a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:46.631637 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53124e3c-f7d1-4410-87a6-b8aa1bca897a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:46.632162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53124e3c-f7d1-4410-87a6-b8aa1bca897a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:46.893876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-53124e3c-f7d1-4410-87a6-b8aa1bca897a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:46.904020 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-53124e3c-f7d1-4410-87a6-b8aa1bca897a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.290977 Nov 11 20:39:46.909223 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 131/242] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:46 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:47.154042 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8a0d63b6-c6ff-42e1-89bb-aff3aaf6bc34 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:47.156502 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8a0d63b6-c6ff-42e1-89bb-aff3aaf6bc34 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:47.166791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8a0d63b6-c6ff-42e1-89bb-aff3aaf6bc34 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:47.167206 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8a0d63b6-c6ff-42e1-89bb-aff3aaf6bc34 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:47.171132 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8a0d63b6-c6ff-42e1-89bb-aff3aaf6bc34 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:47.171770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8a0d63b6-c6ff-42e1-89bb-aff3aaf6bc34 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:47.490182 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8a0d63b6-c6ff-42e1-89bb-aff3aaf6bc34 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:47.514652 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8a0d63b6-c6ff-42e1-89bb-aff3aaf6bc34 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.364481 Nov 11 20:39:47.518714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 132/243] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:47 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:47.627794 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e286432e-7344-4db0-897d-049780bc2671 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:47.628446 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e286432e-7344-4db0-897d-049780bc2671 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:47.640860 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e286432e-7344-4db0-897d-049780bc2671 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:47.641720 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e286432e-7344-4db0-897d-049780bc2671 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:47.642778 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e286432e-7344-4db0-897d-049780bc2671 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:47.643374 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e286432e-7344-4db0-897d-049780bc2671 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:47.839537 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e286432e-7344-4db0-897d-049780bc2671 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:47.847027 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e286432e-7344-4db0-897d-049780bc2671 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.222847 Nov 11 20:39:47.856656 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 133/244] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:47 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:48.068542 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-79635db9-d068-4323-abf6-71be5b354ef7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'create', calling method: .version_select at 0x7ff3ee43f820>, body: {"keypair": {"name": "tempest-keypair-1319015335"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:48.084159 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-79635db9-d068-4323-abf6-71be5b354ef7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Getting quotas for project b5cef6cece0f4bf49468d6d0e5b6b269. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:39:48.090049 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-79635db9-d068-4323-abf6-71be5b354ef7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Getting quotas for user 4287ba46b5a349ffbb921324d6b06555 and project b5cef6cece0f4bf49468d6d0e5b6b269. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:39:48.533142 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-79635db9-d068-4323-abf6-71be5b354ef7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Getting quotas for project b5cef6cece0f4bf49468d6d0e5b6b269. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:39:48.538940 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-79635db9-d068-4323-abf6-71be5b354ef7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Getting quotas for user 4287ba46b5a349ffbb921324d6b06555 and project b5cef6cece0f4bf49468d6d0e5b6b269. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:39:48.555119 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-79635db9-d068-4323-abf6-71be5b354ef7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.701425 Nov 11 20:39:48.561239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 134/245] 10.222.0.61 () {60 vars in 1157 bytes} [Thu Nov 11 20:39:47 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:48.565190 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-478ee551-f267-4950-9832-cba90c9e2acd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:48.565796 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-478ee551-f267-4950-9832-cba90c9e2acd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:48.572642 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-478ee551-f267-4950-9832-cba90c9e2acd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:48.573176 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-478ee551-f267-4950-9832-cba90c9e2acd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:48.574162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-478ee551-f267-4950-9832-cba90c9e2acd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:48.574543 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-478ee551-f267-4950-9832-cba90c9e2acd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:48.795245 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-478ee551-f267-4950-9832-cba90c9e2acd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:48.808690 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-478ee551-f267-4950-9832-cba90c9e2acd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.246753 Nov 11 20:39:48.818573 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 135/246] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:48 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:48.831624 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-24b3c0cf-2a00-4cfa-96b0-06da911e5f46 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:48.832955 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-24b3c0cf-2a00-4cfa-96b0-06da911e5f46 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:48.847627 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-24b3c0cf-2a00-4cfa-96b0-06da911e5f46 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:48.849108 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-24b3c0cf-2a00-4cfa-96b0-06da911e5f46 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:48.858315 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-24b3c0cf-2a00-4cfa-96b0-06da911e5f46 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:48.859296 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-24b3c0cf-2a00-4cfa-96b0-06da911e5f46 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:49.195349 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-24b3c0cf-2a00-4cfa-96b0-06da911e5f46 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:49.203717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-24b3c0cf-2a00-4cfa-96b0-06da911e5f46 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.380806 Nov 11 20:39:49.204281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 136/247] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:48 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:49.234747 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f028fa56-05ff-4105-823e-6633acb4ad6b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:49.237642 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f028fa56-05ff-4105-823e-6633acb4ad6b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:49.251830 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f028fa56-05ff-4105-823e-6633acb4ad6b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:49.252487 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f028fa56-05ff-4105-823e-6633acb4ad6b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:49.253337 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f028fa56-05ff-4105-823e-6633acb4ad6b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:49.253718 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f028fa56-05ff-4105-823e-6633acb4ad6b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:49.602287 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f028fa56-05ff-4105-823e-6633acb4ad6b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:49.625973 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f028fa56-05ff-4105-823e-6633acb4ad6b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.397671 Nov 11 20:39:49.627496 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 137/248] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:49 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:49.829784 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d0283461-ac07-4a1b-908e-aab09f880cc1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:49.831019 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d0283461-ac07-4a1b-908e-aab09f880cc1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:49.854254 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d0283461-ac07-4a1b-908e-aab09f880cc1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:49.860223 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d0283461-ac07-4a1b-908e-aab09f880cc1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:49.860223 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d0283461-ac07-4a1b-908e-aab09f880cc1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:49.860223 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d0283461-ac07-4a1b-908e-aab09f880cc1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:50.182737 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d0283461-ac07-4a1b-908e-aab09f880cc1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:50.193076 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d0283461-ac07-4a1b-908e-aab09f880cc1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.370798 Nov 11 20:39:50.201246 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 138/249] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:49 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:50.225237 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f7502bef-57d7-4a47-85dd-7c82ad19f7a2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:50.225757 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f7502bef-57d7-4a47-85dd-7c82ad19f7a2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:50.244336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f7502bef-57d7-4a47-85dd-7c82ad19f7a2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:50.245075 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f7502bef-57d7-4a47-85dd-7c82ad19f7a2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:50.246317 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f7502bef-57d7-4a47-85dd-7c82ad19f7a2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:50.246891 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f7502bef-57d7-4a47-85dd-7c82ad19f7a2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:50.539640 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f7502bef-57d7-4a47-85dd-7c82ad19f7a2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:50.566008 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f7502bef-57d7-4a47-85dd-7c82ad19f7a2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.348492 Nov 11 20:39:50.582895 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 139/250] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:50 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:50.652048 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ca387f4a-7a06-4116-8132-6906d3c0d25b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:50.668353 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ca387f4a-7a06-4116-8132-6906d3c0d25b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:50.688637 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca387f4a-7a06-4116-8132-6906d3c0d25b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:50.694543 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca387f4a-7a06-4116-8132-6906d3c0d25b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:50.696344 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca387f4a-7a06-4116-8132-6906d3c0d25b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:50.707886 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca387f4a-7a06-4116-8132-6906d3c0d25b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:51.053965 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ca387f4a-7a06-4116-8132-6906d3c0d25b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:51.072351 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ca387f4a-7a06-4116-8132-6906d3c0d25b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.433366 Nov 11 20:39:51.076713 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 140/251] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:50 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:51.221859 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5f76bc36-720f-4da8-a45c-1e3f3e97db9b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:51.223546 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5f76bc36-720f-4da8-a45c-1e3f3e97db9b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:51.258486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5f76bc36-720f-4da8-a45c-1e3f3e97db9b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:51.259154 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5f76bc36-720f-4da8-a45c-1e3f3e97db9b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:51.260544 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5f76bc36-720f-4da8-a45c-1e3f3e97db9b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:51.261149 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5f76bc36-720f-4da8-a45c-1e3f3e97db9b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:51.516290 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5f76bc36-720f-4da8-a45c-1e3f3e97db9b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:51.537903 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5f76bc36-720f-4da8-a45c-1e3f3e97db9b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.322898 Nov 11 20:39:51.542842 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 141/252] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:51 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:51.590472 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7c4ffc0c-44ee-4b89-9bcd-e51a63935ae4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:51.591346 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7c4ffc0c-44ee-4b89-9bcd-e51a63935ae4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:51.598355 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7c4ffc0c-44ee-4b89-9bcd-e51a63935ae4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:51.599245 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7c4ffc0c-44ee-4b89-9bcd-e51a63935ae4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:51.600231 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7c4ffc0c-44ee-4b89-9bcd-e51a63935ae4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:51.601317 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7c4ffc0c-44ee-4b89-9bcd-e51a63935ae4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:51.842570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7c4ffc0c-44ee-4b89-9bcd-e51a63935ae4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:51.851747 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7c4ffc0c-44ee-4b89-9bcd-e51a63935ae4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.264796 Nov 11 20:39:51.852450 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 142/253] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:51 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:51.865246 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1939216063", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "515d5239-5614-4a6a-85cb-8dd4e9ebdc6b"}], "security_groups": [{"name": "tempest-securitygroup--232932801"}], "key_name": "tempest-keypair-1319015335", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:52.038334 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.network.neutron [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] validate_networks() for [('515d5239-5614-4a6a-85cb-8dd4e9ebdc6b', None, None, None, None, None)] {{(pid=122526) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:39:52.847163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Flavor limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:39:52.847841 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Image limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:39:52.848882 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Flavor pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:39:52.849361 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Image pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:39:52.849814 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:39:52.872275 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:52.873179 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:52.875052 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:52.876152 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:52.900666 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Getting quotas for project b5cef6cece0f4bf49468d6d0e5b6b269. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:39:52.905547 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Getting quotas for user 4287ba46b5a349ffbb921324d6b06555 and project b5cef6cece0f4bf49468d6d0e5b6b269. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:39:52.919789 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Going to run 1 instances... {{(pid=122526) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:39:52.922224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:39:52.976265 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-75b7ce0d-bb5f-4379-89ec-50681369e051 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.122517 Nov 11 20:39:52.976911 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 143/254] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:39:51 2021] POST /compute/v2.1/servers => generated 401 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:39:52.982224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c2aab956-8ff7-427d-b9fe-cad0673eb6ae tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:52.982224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c2aab956-8ff7-427d-b9fe-cad0673eb6ae tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:52.987765 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c2aab956-8ff7-427d-b9fe-cad0673eb6ae tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:52.988314 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c2aab956-8ff7-427d-b9fe-cad0673eb6ae tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:52.989396 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c2aab956-8ff7-427d-b9fe-cad0673eb6ae tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:52.989786 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c2aab956-8ff7-427d-b9fe-cad0673eb6ae tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:53.181430 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c2aab956-8ff7-427d-b9fe-cad0673eb6ae tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:53.189331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c2aab956-8ff7-427d-b9fe-cad0673eb6ae tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.211399 Nov 11 20:39:53.206660 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 144/255] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:52 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:53.214830 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2b213104-6e76-42b5-af4c-528971b8be2f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:53.215665 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2b213104-6e76-42b5-af4c-528971b8be2f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:53.226100 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2b213104-6e76-42b5-af4c-528971b8be2f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:53.226775 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2b213104-6e76-42b5-af4c-528971b8be2f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:53.227921 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2b213104-6e76-42b5-af4c-528971b8be2f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:53.228534 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2b213104-6e76-42b5-af4c-528971b8be2f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:53.718830 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2b213104-6e76-42b5-af4c-528971b8be2f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:53.741390 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2b213104-6e76-42b5-af4c-528971b8be2f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.529395 Nov 11 20:39:53.742145 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 145/256] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:53 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:53.749138 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-228c657f-8c09-4642-bfc2-9c0f8f3be24a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:53.750265 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-228c657f-8c09-4642-bfc2-9c0f8f3be24a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:53.767560 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-228c657f-8c09-4642-bfc2-9c0f8f3be24a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:53.769099 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-228c657f-8c09-4642-bfc2-9c0f8f3be24a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:53.781044 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-228c657f-8c09-4642-bfc2-9c0f8f3be24a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:53.784010 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-228c657f-8c09-4642-bfc2-9c0f8f3be24a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:54.066868 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-228c657f-8c09-4642-bfc2-9c0f8f3be24a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:54.079032 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-228c657f-8c09-4642-bfc2-9c0f8f3be24a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.333656 Nov 11 20:39:54.082996 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 146/257] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:53 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:54.100839 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-09c65295-793d-41e1-a0eb-265197485a8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:54.101490 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-09c65295-793d-41e1-a0eb-265197485a8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:54.110948 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-09c65295-793d-41e1-a0eb-265197485a8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:54.111395 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-09c65295-793d-41e1-a0eb-265197485a8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:54.112211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-09c65295-793d-41e1-a0eb-265197485a8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:54.112639 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-09c65295-793d-41e1-a0eb-265197485a8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:54.195335 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-09c65295-793d-41e1-a0eb-265197485a8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:54.203316 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-09c65295-793d-41e1-a0eb-265197485a8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1242 microversion: 2.1 time: 0.118928 Nov 11 20:39:54.204155 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 147/258] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:54 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:54.228871 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1185584769", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "networks": [{"uuid": "ce672723-6882-4ab4-9659-ebe86d0ace99"}]}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:39:54.308871 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.network.neutron [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] validate_networks() for [('ce672723-6882-4ab4-9659-ebe86d0ace99', None, None, None, None, None)] {{(pid=122526) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:39:54.722116 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Flavor limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:39:54.722573 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Image limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:39:54.723686 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Flavor pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:39:54.724126 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Image pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:39:54.724535 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:39:54.732967 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:54.733407 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:54.734210 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:54.734639 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:54.751273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Getting quotas for project da3138643605461997fb39e99bac9845. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:39:54.755253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Getting quotas for user 67e9b275844d430db3a1826bb4306612 and project da3138643605461997fb39e99bac9845. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:39:54.766107 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Going to run 1 instances... {{(pid=122526) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:39:54.768376 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:39:54.813661 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-25667330-c339-415d-bbd7-0f0c3bfb71d5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596005 Nov 11 20:39:54.814404 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 148/259] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:39:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:39:54.819280 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-61b58c22-561a-4cae-bd53-d3ae2bcceba3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:54.820188 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-61b58c22-561a-4cae-bd53-d3ae2bcceba3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:54.847235 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61b58c22-561a-4cae-bd53-d3ae2bcceba3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:54.847756 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61b58c22-561a-4cae-bd53-d3ae2bcceba3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:54.849350 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61b58c22-561a-4cae-bd53-d3ae2bcceba3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:54.849785 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61b58c22-561a-4cae-bd53-d3ae2bcceba3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:55.012822 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-61b58c22-561a-4cae-bd53-d3ae2bcceba3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:55.021758 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-61b58c22-561a-4cae-bd53-d3ae2bcceba3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.206150 Nov 11 20:39:55.022569 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 149/260] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:54 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:55.027143 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-84f0c4b7-0bdd-4a23-82d2-4382ea56d473 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:55.027935 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-84f0c4b7-0bdd-4a23-82d2-4382ea56d473 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:55.034364 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-84f0c4b7-0bdd-4a23-82d2-4382ea56d473 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:55.034832 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-84f0c4b7-0bdd-4a23-82d2-4382ea56d473 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:55.035996 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-84f0c4b7-0bdd-4a23-82d2-4382ea56d473 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:55.036335 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-84f0c4b7-0bdd-4a23-82d2-4382ea56d473 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:55.265736 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-84f0c4b7-0bdd-4a23-82d2-4382ea56d473 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:55.284230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-84f0c4b7-0bdd-4a23-82d2-4382ea56d473 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.260348 Nov 11 20:39:55.285074 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 150/261] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:55 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:55.294123 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3e010773-0242-4722-a6cc-fc199f8121c7 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:55.306734 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3e010773-0242-4722-a6cc-fc199f8121c7 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:55.382613 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3e010773-0242-4722-a6cc-fc199f8121c7 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:55.391050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3e010773-0242-4722-a6cc-fc199f8121c7 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1214 microversion: 2.1 time: 0.100362 Nov 11 20:39:55.392063 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 151/262] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:55 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:55.405152 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bace4384-53c1-489c-9a54-5f138ac1e166 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:55.406114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-bace4384-53c1-489c-9a54-5f138ac1e166 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:55.413019 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bace4384-53c1-489c-9a54-5f138ac1e166 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:55.413459 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bace4384-53c1-489c-9a54-5f138ac1e166 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:55.414230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bace4384-53c1-489c-9a54-5f138ac1e166 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:55.414654 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bace4384-53c1-489c-9a54-5f138ac1e166 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:55.566407 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-bace4384-53c1-489c-9a54-5f138ac1e166 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:55.581915 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bace4384-53c1-489c-9a54-5f138ac1e166 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.188555 Nov 11 20:39:55.583191 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 152/263] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:55 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:55.587674 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9bf8f716-24fe-4ea7-8c6b-c0f3590905bf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:55.588548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9bf8f716-24fe-4ea7-8c6b-c0f3590905bf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:55.594526 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9bf8f716-24fe-4ea7-8c6b-c0f3590905bf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:55.595072 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9bf8f716-24fe-4ea7-8c6b-c0f3590905bf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:55.595924 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9bf8f716-24fe-4ea7-8c6b-c0f3590905bf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:55.596494 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9bf8f716-24fe-4ea7-8c6b-c0f3590905bf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:55.669290 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9bf8f716-24fe-4ea7-8c6b-c0f3590905bf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:55.680257 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9bf8f716-24fe-4ea7-8c6b-c0f3590905bf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1242 microversion: 2.1 time: 0.095013 Nov 11 20:39:55.681334 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 153/264] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:55 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:56.045636 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e63f065c-0277-4927-915d-35e1ec5822bb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:56.046544 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e63f065c-0277-4927-915d-35e1ec5822bb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:56.055645 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e63f065c-0277-4927-915d-35e1ec5822bb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:56.056360 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e63f065c-0277-4927-915d-35e1ec5822bb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:56.057306 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e63f065c-0277-4927-915d-35e1ec5822bb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:56.057890 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e63f065c-0277-4927-915d-35e1ec5822bb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:56.283714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e63f065c-0277-4927-915d-35e1ec5822bb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:56.305394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e63f065c-0277-4927-915d-35e1ec5822bb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.262028 Nov 11 20:39:56.305394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 154/265] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:56 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:56.310599 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b85a9904-63fe-4d52-ae67-d6108ffb6c8b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:56.311418 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b85a9904-63fe-4d52-ae67-d6108ffb6c8b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:56.320526 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b85a9904-63fe-4d52-ae67-d6108ffb6c8b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:56.320975 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b85a9904-63fe-4d52-ae67-d6108ffb6c8b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:56.321756 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b85a9904-63fe-4d52-ae67-d6108ffb6c8b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:56.322211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b85a9904-63fe-4d52-ae67-d6108ffb6c8b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:56.504881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b85a9904-63fe-4d52-ae67-d6108ffb6c8b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:56.513110 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b85a9904-63fe-4d52-ae67-d6108ffb6c8b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.206238 Nov 11 20:39:56.513693 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 155/266] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:56 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:56.528109 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c0feb48e-a834-4118-a4ae-c051ef477260 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:56.528894 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c0feb48e-a834-4118-a4ae-c051ef477260 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:56.534864 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c0feb48e-a834-4118-a4ae-c051ef477260 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:56.536047 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c0feb48e-a834-4118-a4ae-c051ef477260 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:56.555227 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c0feb48e-a834-4118-a4ae-c051ef477260 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:56.568001 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c0feb48e-a834-4118-a4ae-c051ef477260 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:56.651573 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c0feb48e-a834-4118-a4ae-c051ef477260 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:56.656445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c0feb48e-a834-4118-a4ae-c051ef477260 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1218 microversion: 2.1 time: 0.131745 Nov 11 20:39:56.666755 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 156/267] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:56 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:56.666755 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fbf4eb1a-7c38-44f3-822f-5ddb95d5d074 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:56.666755 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fbf4eb1a-7c38-44f3-822f-5ddb95d5d074 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:56.669836 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbf4eb1a-7c38-44f3-822f-5ddb95d5d074 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:56.670499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbf4eb1a-7c38-44f3-822f-5ddb95d5d074 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:56.672147 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbf4eb1a-7c38-44f3-822f-5ddb95d5d074 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:56.672883 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbf4eb1a-7c38-44f3-822f-5ddb95d5d074 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:56.895023 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fbf4eb1a-7c38-44f3-822f-5ddb95d5d074 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:56.903134 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fbf4eb1a-7c38-44f3-822f-5ddb95d5d074 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.244791 Nov 11 20:39:56.903843 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 157/268] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:56 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:56.916099 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-236c7908-802b-49e3-bd4a-d4920a51c736 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:56.916800 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-236c7908-802b-49e3-bd4a-d4920a51c736 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:56.923808 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-236c7908-802b-49e3-bd4a-d4920a51c736 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:56.924352 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-236c7908-802b-49e3-bd4a-d4920a51c736 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:56.925357 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-236c7908-802b-49e3-bd4a-d4920a51c736 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:56.926377 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-236c7908-802b-49e3-bd4a-d4920a51c736 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:57.014373 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-236c7908-802b-49e3-bd4a-d4920a51c736 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:57.032851 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-236c7908-802b-49e3-bd4a-d4920a51c736 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1242 microversion: 2.1 time: 0.127368 Nov 11 20:39:57.033935 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 158/269] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:56 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1242 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:57.320381 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3980091c-025f-42cc-b812-b5576cbe5a21 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:57.320996 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3980091c-025f-42cc-b812-b5576cbe5a21 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:57.327599 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3980091c-025f-42cc-b812-b5576cbe5a21 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:57.328074 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3980091c-025f-42cc-b812-b5576cbe5a21 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:57.328887 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3980091c-025f-42cc-b812-b5576cbe5a21 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:57.329315 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3980091c-025f-42cc-b812-b5576cbe5a21 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:57.464568 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3980091c-025f-42cc-b812-b5576cbe5a21 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:57.473557 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3980091c-025f-42cc-b812-b5576cbe5a21 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.156224 Nov 11 20:39:57.485126 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 159/270] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:57 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:57.531817 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8ed99160-9c35-45b7-b4d2-7710e8315bdd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:57.532944 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8ed99160-9c35-45b7-b4d2-7710e8315bdd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:57.541147 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ed99160-9c35-45b7-b4d2-7710e8315bdd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:57.541686 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ed99160-9c35-45b7-b4d2-7710e8315bdd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:57.542776 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ed99160-9c35-45b7-b4d2-7710e8315bdd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:57.543206 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ed99160-9c35-45b7-b4d2-7710e8315bdd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:57.718797 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8ed99160-9c35-45b7-b4d2-7710e8315bdd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:57.729140 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8ed99160-9c35-45b7-b4d2-7710e8315bdd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.202678 Nov 11 20:39:57.737235 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 160/271] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:57 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:57.744489 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-53469afc-6137-4b2a-92e7-647dc66b85fd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:57.745384 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-53469afc-6137-4b2a-92e7-647dc66b85fd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:57.752894 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53469afc-6137-4b2a-92e7-647dc66b85fd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:57.753732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53469afc-6137-4b2a-92e7-647dc66b85fd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:57.755424 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53469afc-6137-4b2a-92e7-647dc66b85fd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:57.756555 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53469afc-6137-4b2a-92e7-647dc66b85fd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:57.825858 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-53469afc-6137-4b2a-92e7-647dc66b85fd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:57.834156 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-53469afc-6137-4b2a-92e7-647dc66b85fd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1218 microversion: 2.1 time: 0.095021 Nov 11 20:39:57.835292 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 161/272] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:57 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:57.921967 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8b999376-99f6-412e-bbb6-5f2b2ae67291 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:57.922945 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8b999376-99f6-412e-bbb6-5f2b2ae67291 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:57.936591 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8b999376-99f6-412e-bbb6-5f2b2ae67291 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:57.937620 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8b999376-99f6-412e-bbb6-5f2b2ae67291 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:57.938706 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8b999376-99f6-412e-bbb6-5f2b2ae67291 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:57.939440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8b999376-99f6-412e-bbb6-5f2b2ae67291 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:58.111940 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8b999376-99f6-412e-bbb6-5f2b2ae67291 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:58.122978 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8b999376-99f6-412e-bbb6-5f2b2ae67291 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.206070 Nov 11 20:39:58.132253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 162/273] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:57 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:58.132253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b0358347-0412-4511-b5c2-c3ae4d5125a1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:58.132253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b0358347-0412-4511-b5c2-c3ae4d5125a1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:58.138190 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0358347-0412-4511-b5c2-c3ae4d5125a1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:58.138639 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0358347-0412-4511-b5c2-c3ae4d5125a1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:58.139430 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0358347-0412-4511-b5c2-c3ae4d5125a1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:58.139861 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0358347-0412-4511-b5c2-c3ae4d5125a1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:58.205214 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b0358347-0412-4511-b5c2-c3ae4d5125a1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:58.212429 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b0358347-0412-4511-b5c2-c3ae4d5125a1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1242 microversion: 2.1 time: 0.087350 Nov 11 20:39:58.213139 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 163/274] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:58 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:58.502370 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2c83251a-946f-408b-9be4-0f1fc3dc7197 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:58.503253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2c83251a-946f-408b-9be4-0f1fc3dc7197 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:58.510938 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2c83251a-946f-408b-9be4-0f1fc3dc7197 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:58.511387 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2c83251a-946f-408b-9be4-0f1fc3dc7197 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:58.512258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2c83251a-946f-408b-9be4-0f1fc3dc7197 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:58.512698 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2c83251a-946f-408b-9be4-0f1fc3dc7197 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:58.652135 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2c83251a-946f-408b-9be4-0f1fc3dc7197 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:58.659465 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2c83251a-946f-408b-9be4-0f1fc3dc7197 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.160745 Nov 11 20:39:58.660180 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 164/275] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:58 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:58.798173 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b7ffe00c-02b9-458b-8a10-2616542723e1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:58.798785 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b7ffe00c-02b9-458b-8a10-2616542723e1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:58.804702 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b7ffe00c-02b9-458b-8a10-2616542723e1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:58.805152 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b7ffe00c-02b9-458b-8a10-2616542723e1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:58.805930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b7ffe00c-02b9-458b-8a10-2616542723e1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:58.806365 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b7ffe00c-02b9-458b-8a10-2616542723e1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:58.950913 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b7ffe00c-02b9-458b-8a10-2616542723e1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:58.959016 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b7ffe00c-02b9-458b-8a10-2616542723e1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.164572 Nov 11 20:39:58.959578 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 165/276] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:58 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:58.964424 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-34e6a5f1-77cc-43b8-adb3-f7511e26d393 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:58.965023 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-34e6a5f1-77cc-43b8-adb3-f7511e26d393 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:58.970981 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-34e6a5f1-77cc-43b8-adb3-f7511e26d393 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:58.971429 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-34e6a5f1-77cc-43b8-adb3-f7511e26d393 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:58.973109 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-34e6a5f1-77cc-43b8-adb3-f7511e26d393 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:58.973109 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-34e6a5f1-77cc-43b8-adb3-f7511e26d393 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:59.060407 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-34e6a5f1-77cc-43b8-adb3-f7511e26d393 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:59.071410 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-34e6a5f1-77cc-43b8-adb3-f7511e26d393 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1218 microversion: 2.1 time: 0.110271 Nov 11 20:39:59.072669 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 166/277] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:58 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:59.140264 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4691d9a6-eaa1-4596-bea9-1714b1f02577 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:59.140874 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4691d9a6-eaa1-4596-bea9-1714b1f02577 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:59.147082 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4691d9a6-eaa1-4596-bea9-1714b1f02577 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:59.147466 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4691d9a6-eaa1-4596-bea9-1714b1f02577 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:59.148275 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4691d9a6-eaa1-4596-bea9-1714b1f02577 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:59.148711 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4691d9a6-eaa1-4596-bea9-1714b1f02577 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:59.291049 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4691d9a6-eaa1-4596-bea9-1714b1f02577 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:59.298184 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4691d9a6-eaa1-4596-bea9-1714b1f02577 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.161881 Nov 11 20:39:59.298742 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 167/278] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:59 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:39:59.303415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6a86416c-f186-41e0-8a26-531fc437687f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:59.304026 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6a86416c-f186-41e0-8a26-531fc437687f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:59.309911 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6a86416c-f186-41e0-8a26-531fc437687f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:59.310354 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6a86416c-f186-41e0-8a26-531fc437687f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:59.311135 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6a86416c-f186-41e0-8a26-531fc437687f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:59.311563 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6a86416c-f186-41e0-8a26-531fc437687f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:59.605777 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6a86416c-f186-41e0-8a26-531fc437687f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:59.613467 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6a86416c-f186-41e0-8a26-531fc437687f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1242 microversion: 2.1 time: 0.313694 Nov 11 20:39:59.614038 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 168/279] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:59 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1242 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:59.679060 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f89d83bc-4aea-429b-a8ba-6d7788d178d3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:59.680241 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f89d83bc-4aea-429b-a8ba-6d7788d178d3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:59.688553 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f89d83bc-4aea-429b-a8ba-6d7788d178d3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:59.689401 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f89d83bc-4aea-429b-a8ba-6d7788d178d3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:59.690548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f89d83bc-4aea-429b-a8ba-6d7788d178d3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:59.691244 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f89d83bc-4aea-429b-a8ba-6d7788d178d3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:59.835304 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f89d83bc-4aea-429b-a8ba-6d7788d178d3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:39:59.842537 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f89d83bc-4aea-429b-a8ba-6d7788d178d3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.168011 Nov 11 20:39:59.843091 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 169/280] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:59 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:39:59.977848 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c1e64a19-aa93-49ce-b3c3-b4fe09e05366 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:39:59.978634 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c1e64a19-aa93-49ce-b3c3-b4fe09e05366 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:39:59.985079 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c1e64a19-aa93-49ce-b3c3-b4fe09e05366 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:59.985521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c1e64a19-aa93-49ce-b3c3-b4fe09e05366 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:39:59.986306 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c1e64a19-aa93-49ce-b3c3-b4fe09e05366 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:39:59.986758 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c1e64a19-aa93-49ce-b3c3-b4fe09e05366 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:00.126335 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c1e64a19-aa93-49ce-b3c3-b4fe09e05366 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:00.137188 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c1e64a19-aa93-49ce-b3c3-b4fe09e05366 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.164679 Nov 11 20:40:00.140850 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 170/281] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:39:59 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:00.145453 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e313523f-c938-4b30-9ba4-681a593df041 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:00.146199 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e313523f-c938-4b30-9ba4-681a593df041 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:00.152445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e313523f-c938-4b30-9ba4-681a593df041 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:00.152894 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e313523f-c938-4b30-9ba4-681a593df041 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:00.153694 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e313523f-c938-4b30-9ba4-681a593df041 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:00.154133 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e313523f-c938-4b30-9ba4-681a593df041 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:00.214698 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e313523f-c938-4b30-9ba4-681a593df041 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:00.222130 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e313523f-c938-4b30-9ba4-681a593df041 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1218 microversion: 2.1 time: 0.080397 Nov 11 20:40:00.223264 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 171/282] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:00 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:00.316143 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-682a8ed8-de04-4c81-8681-4b19d024cbc6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:00.316735 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-682a8ed8-de04-4c81-8681-4b19d024cbc6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:00.323000 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-682a8ed8-de04-4c81-8681-4b19d024cbc6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:00.323446 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-682a8ed8-de04-4c81-8681-4b19d024cbc6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:00.324292 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-682a8ed8-de04-4c81-8681-4b19d024cbc6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:00.324723 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-682a8ed8-de04-4c81-8681-4b19d024cbc6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:00.456863 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-682a8ed8-de04-4c81-8681-4b19d024cbc6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:00.464814 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-682a8ed8-de04-4c81-8681-4b19d024cbc6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.152478 Nov 11 20:40:00.465377 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 172/283] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:00 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:00.629601 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-813a6a91-a628-450e-944b-3d2305ac8813 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:00.630193 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-813a6a91-a628-450e-944b-3d2305ac8813 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:00.636432 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-813a6a91-a628-450e-944b-3d2305ac8813 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:00.636874 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-813a6a91-a628-450e-944b-3d2305ac8813 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:00.637747 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-813a6a91-a628-450e-944b-3d2305ac8813 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:00.638178 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-813a6a91-a628-450e-944b-3d2305ac8813 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:00.695802 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-813a6a91-a628-450e-944b-3d2305ac8813 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:00.703175 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-813a6a91-a628-450e-944b-3d2305ac8813 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1242 microversion: 2.1 time: 0.077164 Nov 11 20:40:00.703803 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 173/284] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:00 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:00.858570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e90c3b0d-760c-45d1-b1a3-a1e5a514de59 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:00.859083 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e90c3b0d-760c-45d1-b1a3-a1e5a514de59 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:00.865161 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e90c3b0d-760c-45d1-b1a3-a1e5a514de59 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:00.865607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e90c3b0d-760c-45d1-b1a3-a1e5a514de59 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:00.866382 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e90c3b0d-760c-45d1-b1a3-a1e5a514de59 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:00.866819 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e90c3b0d-760c-45d1-b1a3-a1e5a514de59 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:00.996229 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e90c3b0d-760c-45d1-b1a3-a1e5a514de59 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:01.003502 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e90c3b0d-760c-45d1-b1a3-a1e5a514de59 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.148787 Nov 11 20:40:01.004594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 174/285] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:00 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:01.156737 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-505400a7-9f0e-44d4-b43a-29708824e4eb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:01.157412 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-505400a7-9f0e-44d4-b43a-29708824e4eb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:01.163285 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-505400a7-9f0e-44d4-b43a-29708824e4eb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:01.163732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-505400a7-9f0e-44d4-b43a-29708824e4eb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:01.164556 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-505400a7-9f0e-44d4-b43a-29708824e4eb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:01.164986 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-505400a7-9f0e-44d4-b43a-29708824e4eb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:01.292830 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-505400a7-9f0e-44d4-b43a-29708824e4eb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:01.299911 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-505400a7-9f0e-44d4-b43a-29708824e4eb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.146822 Nov 11 20:40:01.300496 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 175/286] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:01 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:01.305681 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2dab8fc2-2c8d-42dd-970b-e441200a70c3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:01.306274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2dab8fc2-2c8d-42dd-970b-e441200a70c3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:01.311930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2dab8fc2-2c8d-42dd-970b-e441200a70c3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:01.312414 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2dab8fc2-2c8d-42dd-970b-e441200a70c3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:01.313180 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2dab8fc2-2c8d-42dd-970b-e441200a70c3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:01.313608 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2dab8fc2-2c8d-42dd-970b-e441200a70c3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:01.370789 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2dab8fc2-2c8d-42dd-970b-e441200a70c3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:01.377975 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2dab8fc2-2c8d-42dd-970b-e441200a70c3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1218 microversion: 2.1 time: 0.075535 Nov 11 20:40:01.378554 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 176/287] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:01 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:01.482236 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d0f63edd-71b3-48b1-9bd0-a2ff4ddc9d24 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:01.482757 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d0f63edd-71b3-48b1-9bd0-a2ff4ddc9d24 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:01.489244 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d0f63edd-71b3-48b1-9bd0-a2ff4ddc9d24 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:01.489694 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d0f63edd-71b3-48b1-9bd0-a2ff4ddc9d24 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:01.490465 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d0f63edd-71b3-48b1-9bd0-a2ff4ddc9d24 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:01.490896 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d0f63edd-71b3-48b1-9bd0-a2ff4ddc9d24 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:01.619511 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d0f63edd-71b3-48b1-9bd0-a2ff4ddc9d24 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:01.626774 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d0f63edd-71b3-48b1-9bd0-a2ff4ddc9d24 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.148136 Nov 11 20:40:01.627334 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 177/288] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:01 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:01.720686 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-205004ef-d458-4f4f-be80-3e66503ebd1b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:01.721400 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-205004ef-d458-4f4f-be80-3e66503ebd1b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:01.727995 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-205004ef-d458-4f4f-be80-3e66503ebd1b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:01.728437 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-205004ef-d458-4f4f-be80-3e66503ebd1b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:01.729212 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-205004ef-d458-4f4f-be80-3e66503ebd1b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:01.729638 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-205004ef-d458-4f4f-be80-3e66503ebd1b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:01.787015 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-205004ef-d458-4f4f-be80-3e66503ebd1b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:01.794305 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-205004ef-d458-4f4f-be80-3e66503ebd1b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1242 microversion: 2.1 time: 0.077240 Nov 11 20:40:01.794862 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 178/289] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:01 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:02.021225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-425113b7-2e5d-440b-8e0d-45b4dbe93f0f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:02.021831 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-425113b7-2e5d-440b-8e0d-45b4dbe93f0f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:02.027915 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-425113b7-2e5d-440b-8e0d-45b4dbe93f0f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:02.028402 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-425113b7-2e5d-440b-8e0d-45b4dbe93f0f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:02.029249 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-425113b7-2e5d-440b-8e0d-45b4dbe93f0f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:02.029690 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-425113b7-2e5d-440b-8e0d-45b4dbe93f0f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:02.170371 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-425113b7-2e5d-440b-8e0d-45b4dbe93f0f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:02.178186 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-425113b7-2e5d-440b-8e0d-45b4dbe93f0f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.161021 Nov 11 20:40:02.178958 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 179/290] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:02 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:02.296590 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d9e480cf-3f85-4a59-b95b-b992d1e10396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 27159 microversion: 2.20 time: 20.969629 Nov 11 20:40:02.297575 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 112/291] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:39:41 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 27159 bytes in 20974 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:02.316968 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-26a3cdc7-a66c-43d7-84d7-1ac9772e2b22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:02.318006 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-26a3cdc7-a66c-43d7-84d7-1ac9772e2b22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:02.325870 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-26a3cdc7-a66c-43d7-84d7-1ac9772e2b22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:02.326319 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-26a3cdc7-a66c-43d7-84d7-1ac9772e2b22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:02.327097 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-26a3cdc7-a66c-43d7-84d7-1ac9772e2b22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:02.327533 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-26a3cdc7-a66c-43d7-84d7-1ac9772e2b22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:02.397179 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0d26d4ea-60e3-4805-bc01-16714e119707 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:02.397883 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0d26d4ea-60e3-4805-bc01-16714e119707 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:02.406395 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d26d4ea-60e3-4805-bc01-16714e119707 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:02.406842 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d26d4ea-60e3-4805-bc01-16714e119707 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:02.407644 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d26d4ea-60e3-4805-bc01-16714e119707 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:02.408100 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d26d4ea-60e3-4805-bc01-16714e119707 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:02.564187 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0d26d4ea-60e3-4805-bc01-16714e119707 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:02.573776 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0d26d4ea-60e3-4805-bc01-16714e119707 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1210 microversion: 2.1 time: 0.181837 Nov 11 20:40:02.574454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 113/292] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:02 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1210 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:02.645719 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-34e8af56-e704-41ea-a90d-71fee081021e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:02.646953 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-34e8af56-e704-41ea-a90d-71fee081021e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:02.653732 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-34e8af56-e704-41ea-a90d-71fee081021e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:02.654271 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-34e8af56-e704-41ea-a90d-71fee081021e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:02.655380 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-34e8af56-e704-41ea-a90d-71fee081021e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:02.655680 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-34e8af56-e704-41ea-a90d-71fee081021e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:02.807518 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-26a3cdc7-a66c-43d7-84d7-1ac9772e2b22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:02.815103 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-26a3cdc7-a66c-43d7-84d7-1ac9772e2b22 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.501645 Nov 11 20:40:02.815675 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 180/293] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:02 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:02.820834 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9717a828-ebd5-40e7-87b6-3302f931656b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:02.821513 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9717a828-ebd5-40e7-87b6-3302f931656b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:02.828670 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9717a828-ebd5-40e7-87b6-3302f931656b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:02.828670 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9717a828-ebd5-40e7-87b6-3302f931656b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:02.829455 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9717a828-ebd5-40e7-87b6-3302f931656b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:02.829892 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9717a828-ebd5-40e7-87b6-3302f931656b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:02.933063 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9717a828-ebd5-40e7-87b6-3302f931656b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:02.942601 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9717a828-ebd5-40e7-87b6-3302f931656b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1290 microversion: 2.1 time: 0.125024 Nov 11 20:40:02.943442 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 181/294] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:02 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1290 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:03.029189 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-34e8af56-e704-41ea-a90d-71fee081021e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:03.038301 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-34e8af56-e704-41ea-a90d-71fee081021e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.398657 Nov 11 20:40:03.039004 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 114/295] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:02 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:03.206618 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-723c4201-38c9-4d8b-a523-4c66f7fb818b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:03.210864 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-723c4201-38c9-4d8b-a523-4c66f7fb818b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:03.240761 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-723c4201-38c9-4d8b-a523-4c66f7fb818b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:03.241209 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-723c4201-38c9-4d8b-a523-4c66f7fb818b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:03.242017 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-723c4201-38c9-4d8b-a523-4c66f7fb818b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:03.242473 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-723c4201-38c9-4d8b-a523-4c66f7fb818b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:03.312244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d3454763-3410-40b1-ad54-238ee1e54d83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:03.313272 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d3454763-3410-40b1-ad54-238ee1e54d83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:03.329184 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d3454763-3410-40b1-ad54-238ee1e54d83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:03.331161 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d3454763-3410-40b1-ad54-238ee1e54d83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:03.334542 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d3454763-3410-40b1-ad54-238ee1e54d83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:03.335264 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d3454763-3410-40b1-ad54-238ee1e54d83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:03.480111 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d3454763-3410-40b1-ad54-238ee1e54d83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 27381 microversion: 2.20 time: 0.173369 Nov 11 20:40:03.480765 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 115/296] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:03 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 27381 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:03.488025 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-524469121", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:03.553720 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.network.neutron [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] validate_networks() for None {{(pid=122527) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:40:03.958656 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-723c4201-38c9-4d8b-a523-4c66f7fb818b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:03.972584 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-723c4201-38c9-4d8b-a523-4c66f7fb818b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.781489 Nov 11 20:40:03.974322 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 182/297] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:03 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:03.978881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-061d9328-a6dd-4faa-b8e3-fabc82659d8b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:03.981550 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-061d9328-a6dd-4faa-b8e3-fabc82659d8b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:03.993314 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-061d9328-a6dd-4faa-b8e3-fabc82659d8b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:03.996176 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-061d9328-a6dd-4faa-b8e3-fabc82659d8b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:03.997271 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-061d9328-a6dd-4faa-b8e3-fabc82659d8b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:04.000115 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-061d9328-a6dd-4faa-b8e3-fabc82659d8b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:04.161481 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-061d9328-a6dd-4faa-b8e3-fabc82659d8b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:04.173479 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-061d9328-a6dd-4faa-b8e3-fabc82659d8b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1274 microversion: 2.1 time: 0.197760 Nov 11 20:40:04.174523 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 183/298] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:03 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:04.180903 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fc6401b1-248b-44d5-a85a-65484bab84bb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:04.181903 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fc6401b1-248b-44d5-a85a-65484bab84bb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:04.194870 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fc6401b1-248b-44d5-a85a-65484bab84bb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:04.195452 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fc6401b1-248b-44d5-a85a-65484bab84bb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:04.196441 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fc6401b1-248b-44d5-a85a-65484bab84bb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:04.196970 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fc6401b1-248b-44d5-a85a-65484bab84bb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:04.563960 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Flavor limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:40:04.564803 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Image limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:40:04.565277 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Flavor pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:40:04.565688 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Image pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:40:04.566101 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:40:04.576976 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:04.577637 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:04.578766 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:04.579352 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:04.598046 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Getting quotas for project f318ff0715454413b9ed68f3e56c7bbc. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:40:04.602543 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Getting quotas for user c1e34575bced464692b3eeee216d2b58 and project f318ff0715454413b9ed68f3e56c7bbc. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:40:04.614625 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Going to run 1 instances... {{(pid=122527) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:40:04.617632 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:40:04.666777 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-84bf09fc-86ef-4513-a45c-f629b5755899 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.184153 Nov 11 20:40:04.668218 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 116/299] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:40:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:40:04.672783 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4e48452e-9c34-4ac4-b728-5fb8377f49f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:04.673564 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4e48452e-9c34-4ac4-b728-5fb8377f49f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:04.681777 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4e48452e-9c34-4ac4-b728-5fb8377f49f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:04.682450 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4e48452e-9c34-4ac4-b728-5fb8377f49f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:04.683542 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4e48452e-9c34-4ac4-b728-5fb8377f49f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:04.684154 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4e48452e-9c34-4ac4-b728-5fb8377f49f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:04.814287 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-4e48452e-9c34-4ac4-b728-5fb8377f49f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:04.824409 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4e48452e-9c34-4ac4-b728-5fb8377f49f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1296 microversion: 2.1 time: 0.154928 Nov 11 20:40:04.825998 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 117/300] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:04 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1296 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:04.831001 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-06274f52-69fe-4ea9-b7bf-cdd930959fe1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:04.831509 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-06274f52-69fe-4ea9-b7bf-cdd930959fe1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:04.841047 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-06274f52-69fe-4ea9-b7bf-cdd930959fe1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:04.848988 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-06274f52-69fe-4ea9-b7bf-cdd930959fe1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:04.849574 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-06274f52-69fe-4ea9-b7bf-cdd930959fe1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:04.850020 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-06274f52-69fe-4ea9-b7bf-cdd930959fe1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:04.922033 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fc6401b1-248b-44d5-a85a-65484bab84bb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:04.944829 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fc6401b1-248b-44d5-a85a-65484bab84bb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.769008 Nov 11 20:40:04.946346 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 184/301] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:04 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:04.951158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-a796b617-5028-4e40-b6c4-0528f507b32c req-0d91cf8c-3b78-4442-a560-a03b1ddb0d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28d94ff-cfbb-46b3-b20d-32a6cb35893e", "tag": "30542ce7-fdf6-41e0-981e-8ee1bf98723f"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:04.958420 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:04.958420 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:04.970634 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-a796b617-5028-4e40-b6c4-0528f507b32c req-0d91cf8c-3b78-4442-a560-a03b1ddb0d7a service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:04.979105 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-a796b617-5028-4e40-b6c4-0528f507b32c req-0d91cf8c-3b78-4442-a560-a03b1ddb0d7a service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:04.999216 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-a796b617-5028-4e40-b6c4-0528f507b32c req-0d91cf8c-3b78-4442-a560-a03b1ddb0d7a service nova] Creating event network-changed:30542ce7-fdf6-41e0-981e-8ee1bf98723f for instance d28d94ff-cfbb-46b3-b20d-32a6cb35893e on hv-cinder-81764 Nov 11 20:40:05.016755 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-a796b617-5028-4e40-b6c4-0528f507b32c req-0d91cf8c-3b78-4442-a560-a03b1ddb0d7a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068998 Nov 11 20:40:05.017809 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 185/302] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:05.024923 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-22a53c52-83a7-4f8a-b2fe-0a7a72961d3e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:05.035143 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-22a53c52-83a7-4f8a-b2fe-0a7a72961d3e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:05.044678 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-22a53c52-83a7-4f8a-b2fe-0a7a72961d3e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:05.045499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-22a53c52-83a7-4f8a-b2fe-0a7a72961d3e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:05.046545 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-22a53c52-83a7-4f8a-b2fe-0a7a72961d3e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:05.047186 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-22a53c52-83a7-4f8a-b2fe-0a7a72961d3e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:05.176583 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-06274f52-69fe-4ea9-b7bf-cdd930959fe1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:05.184896 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-22a53c52-83a7-4f8a-b2fe-0a7a72961d3e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 27658 microversion: 2.20 time: 0.165231 Nov 11 20:40:05.189260 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 186/303] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:05 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 27658 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:05.190996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-06274f52-69fe-4ea9-b7bf-cdd930959fe1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.363531 Nov 11 20:40:05.192138 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 118/304] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:04 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:05.195040 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a7396ec9-e58b-4973-ae8d-62b950a8e604 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:05.195411 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a7396ec9-e58b-4973-ae8d-62b950a8e604 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:05.206178 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c5d4560d-42b3-4986-b80f-538bc44e4740 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:05.207930 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c5d4560d-42b3-4986-b80f-538bc44e4740 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:05.215257 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c5d4560d-42b3-4986-b80f-538bc44e4740 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:05.215954 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c5d4560d-42b3-4986-b80f-538bc44e4740 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:05.216983 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c5d4560d-42b3-4986-b80f-538bc44e4740 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:05.217947 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c5d4560d-42b3-4986-b80f-538bc44e4740 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:05.339215 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a7396ec9-e58b-4973-ae8d-62b950a8e604 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:05.345933 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a7396ec9-e58b-4973-ae8d-62b950a8e604 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1214 microversion: 2.1 time: 0.155435 Nov 11 20:40:05.346497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 187/305] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:05 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:05.352332 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-49f0bc39-c6d2-44b7-bc74-93255c7aefaa tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:05.353122 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-49f0bc39-c6d2-44b7-bc74-93255c7aefaa tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:05.359661 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-49f0bc39-c6d2-44b7-bc74-93255c7aefaa tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:05.360476 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-49f0bc39-c6d2-44b7-bc74-93255c7aefaa tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:05.361447 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-49f0bc39-c6d2-44b7-bc74-93255c7aefaa tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:05.362037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-49f0bc39-c6d2-44b7-bc74-93255c7aefaa tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:05.719002 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c5d4560d-42b3-4986-b80f-538bc44e4740 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:05.729696 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c5d4560d-42b3-4986-b80f-538bc44e4740 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.536117 Nov 11 20:40:05.730454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 119/306] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:05 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:05.744603 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-49f0bc39-c6d2-44b7-bc74-93255c7aefaa tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:05.753124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-49f0bc39-c6d2-44b7-bc74-93255c7aefaa tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1314 microversion: 2.1 time: 0.405419 Nov 11 20:40:05.754523 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 188/307] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:05 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:05.831582 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-b110b74b-b248-4a32-b0cc-23b379cb967b req-99924874-8dce-434e-b01f-8863c407966a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b5e5fb-4793-4495-a93b-321835ecf1b3", "tag": "b01233b4-ce9c-4445-81a3-554fbf132f2f"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:05.833617 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:05.833617 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:40:05.842566 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a733bd6d-e140-41ad-825d-36407490e672 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:05.843178 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a733bd6d-e140-41ad-825d-36407490e672 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:05.855864 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a733bd6d-e140-41ad-825d-36407490e672 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:05.856999 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a733bd6d-e140-41ad-825d-36407490e672 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:05.858820 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a733bd6d-e140-41ad-825d-36407490e672 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:05.859508 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a733bd6d-e140-41ad-825d-36407490e672 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:05.862497 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-b110b74b-b248-4a32-b0cc-23b379cb967b req-99924874-8dce-434e-b01f-8863c407966a service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:05.863094 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-b110b74b-b248-4a32-b0cc-23b379cb967b req-99924874-8dce-434e-b01f-8863c407966a service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:05.877110 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-b110b74b-b248-4a32-b0cc-23b379cb967b req-99924874-8dce-434e-b01f-8863c407966a service nova] Creating event network-changed:b01233b4-ce9c-4445-81a3-554fbf132f2f for instance 09b5e5fb-4793-4495-a93b-321835ecf1b3 on hv-cinder-81764 Nov 11 20:40:05.884954 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-b110b74b-b248-4a32-b0cc-23b379cb967b req-99924874-8dce-434e-b01f-8863c407966a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057839 Nov 11 20:40:05.892036 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 120/308] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:05.964763 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4a653c78-0911-4de6-af4c-c2a4d9c40114 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:05.965908 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4a653c78-0911-4de6-af4c-c2a4d9c40114 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:05.976379 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4a653c78-0911-4de6-af4c-c2a4d9c40114 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:05.977249 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4a653c78-0911-4de6-af4c-c2a4d9c40114 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:05.978074 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4a653c78-0911-4de6-af4c-c2a4d9c40114 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:05.978672 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4a653c78-0911-4de6-af4c-c2a4d9c40114 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:06.255799 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a733bd6d-e140-41ad-825d-36407490e672 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:06.266851 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a733bd6d-e140-41ad-825d-36407490e672 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1363 microversion: 2.1 time: 0.426946 Nov 11 20:40:06.268834 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 189/309] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:05 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1363 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:06.280575 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-60797708-b292-401c-8e76-f84f96621db7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:06.281842 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-60797708-b292-401c-8e76-f84f96621db7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:06.292473 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-60797708-b292-401c-8e76-f84f96621db7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:06.293162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-60797708-b292-401c-8e76-f84f96621db7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:06.294134 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-60797708-b292-401c-8e76-f84f96621db7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:06.294679 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-60797708-b292-401c-8e76-f84f96621db7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:06.358205 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-4a653c78-0911-4de6-af4c-c2a4d9c40114 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:06.366230 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4a653c78-0911-4de6-af4c-c2a4d9c40114 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.407035 Nov 11 20:40:06.367053 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 121/310] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:05 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:06.371805 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5d0199a1-52c4-4fde-bef3-a169c6229ede tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:06.372638 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5d0199a1-52c4-4fde-bef3-a169c6229ede tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:06.378597 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d0199a1-52c4-4fde-bef3-a169c6229ede tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:06.379651 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d0199a1-52c4-4fde-bef3-a169c6229ede tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:06.380802 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d0199a1-52c4-4fde-bef3-a169c6229ede tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:06.381248 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d0199a1-52c4-4fde-bef3-a169c6229ede tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:06.482079 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-60797708-b292-401c-8e76-f84f96621db7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28101 microversion: 2.20 time: 0.210402 Nov 11 20:40:06.483898 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 190/311] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:06 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28101 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:06.491618 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-224ead0d-59f7-49a5-8654-1cbf28c7e512 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:06.492950 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-224ead0d-59f7-49a5-8654-1cbf28c7e512 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:06.501608 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-224ead0d-59f7-49a5-8654-1cbf28c7e512 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:06.502361 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-224ead0d-59f7-49a5-8654-1cbf28c7e512 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:06.503482 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-224ead0d-59f7-49a5-8654-1cbf28c7e512 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:06.505264 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-224ead0d-59f7-49a5-8654-1cbf28c7e512 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:06.624653 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-224ead0d-59f7-49a5-8654-1cbf28c7e512 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:06.636526 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-224ead0d-59f7-49a5-8654-1cbf28c7e512 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1284 microversion: 2.1 time: 0.147869 Nov 11 20:40:06.637271 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 191/312] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:06 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:06.746995 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2060fe57-97fb-4b8e-9857-1cc98a38f4c7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:06.747636 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2060fe57-97fb-4b8e-9857-1cc98a38f4c7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:06.755358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2060fe57-97fb-4b8e-9857-1cc98a38f4c7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:06.755882 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2060fe57-97fb-4b8e-9857-1cc98a38f4c7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:06.756696 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2060fe57-97fb-4b8e-9857-1cc98a38f4c7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:06.757131 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2060fe57-97fb-4b8e-9857-1cc98a38f4c7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:06.936294 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5d0199a1-52c4-4fde-bef3-a169c6229ede tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:06.952345 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5d0199a1-52c4-4fde-bef3-a169c6229ede tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.583855 Nov 11 20:40:06.953610 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 122/313] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:06 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:06.970888 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-eb73a198-1088-4943-9cf1-6ff03cab0a94 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:06.972371 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-eb73a198-1088-4943-9cf1-6ff03cab0a94 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:06.981885 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eb73a198-1088-4943-9cf1-6ff03cab0a94 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:06.982759 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eb73a198-1088-4943-9cf1-6ff03cab0a94 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:06.983776 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eb73a198-1088-4943-9cf1-6ff03cab0a94 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:06.985010 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eb73a198-1088-4943-9cf1-6ff03cab0a94 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:07.369813 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2060fe57-97fb-4b8e-9857-1cc98a38f4c7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:07.381755 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2060fe57-97fb-4b8e-9857-1cc98a38f4c7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.638662 Nov 11 20:40:07.383480 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 192/314] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:06 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:07.389916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5c80fd68-7932-4e47-b332-1fa7c0ab939b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:07.392293 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5c80fd68-7932-4e47-b332-1fa7c0ab939b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:07.400650 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c80fd68-7932-4e47-b332-1fa7c0ab939b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:07.401824 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c80fd68-7932-4e47-b332-1fa7c0ab939b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:07.402965 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c80fd68-7932-4e47-b332-1fa7c0ab939b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:07.403607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c80fd68-7932-4e47-b332-1fa7c0ab939b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:07.902540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-eb73a198-1088-4943-9cf1-6ff03cab0a94 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:07.909869 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-eb73a198-1088-4943-9cf1-6ff03cab0a94 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1314 microversion: 2.1 time: 0.954992 Nov 11 20:40:07.911354 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 123/315] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:06 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1314 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:07.915937 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c586fc20-c175-4047-a2d4-4481bfe71196 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:07.919316 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c586fc20-c175-4047-a2d4-4481bfe71196 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:07.923045 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c586fc20-c175-4047-a2d4-4481bfe71196 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:07.923498 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c586fc20-c175-4047-a2d4-4481bfe71196 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:07.924655 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c586fc20-c175-4047-a2d4-4481bfe71196 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:07.924773 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c586fc20-c175-4047-a2d4-4481bfe71196 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:08.241134 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5c80fd68-7932-4e47-b332-1fa7c0ab939b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:08.249570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5c80fd68-7932-4e47-b332-1fa7c0ab939b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1363 microversion: 2.1 time: 0.864559 Nov 11 20:40:08.260415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 193/316] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:07 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1363 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:08.265585 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-611146dc-9cbd-40c3-a53a-108479ae7acd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:08.266818 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-611146dc-9cbd-40c3-a53a-108479ae7acd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:08.278406 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-611146dc-9cbd-40c3-a53a-108479ae7acd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:08.280584 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-611146dc-9cbd-40c3-a53a-108479ae7acd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:08.281688 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-611146dc-9cbd-40c3-a53a-108479ae7acd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:08.282340 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-611146dc-9cbd-40c3-a53a-108479ae7acd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:08.417108 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-611146dc-9cbd-40c3-a53a-108479ae7acd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28218 microversion: 2.20 time: 0.154835 Nov 11 20:40:08.422727 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c586fc20-c175-4047-a2d4-4481bfe71196 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:08.424002 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 194/317] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:08 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:08.430900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-47bb7f40-8076-4c2f-835c-d7bae509d834 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:08.431836 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-47bb7f40-8076-4c2f-835c-d7bae509d834 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:08.433017 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c586fc20-c175-4047-a2d4-4481bfe71196 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.520308 Nov 11 20:40:08.434149 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 124/318] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:07 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:08.440963 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-73358e93-f768-4dd5-96d9-89b427a267bd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:08.443096 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-73358e93-f768-4dd5-96d9-89b427a267bd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:08.447021 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-47bb7f40-8076-4c2f-835c-d7bae509d834 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:08.447556 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-47bb7f40-8076-4c2f-835c-d7bae509d834 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:08.448442 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-47bb7f40-8076-4c2f-835c-d7bae509d834 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:08.449037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-47bb7f40-8076-4c2f-835c-d7bae509d834 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:08.451655 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-73358e93-f768-4dd5-96d9-89b427a267bd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:08.452386 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-73358e93-f768-4dd5-96d9-89b427a267bd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:08.457454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-73358e93-f768-4dd5-96d9-89b427a267bd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:08.458759 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-73358e93-f768-4dd5-96d9-89b427a267bd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:08.571287 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-47bb7f40-8076-4c2f-835c-d7bae509d834 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:08.579545 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-47bb7f40-8076-4c2f-835c-d7bae509d834 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1272 microversion: 2.1 time: 0.153802 Nov 11 20:40:08.580232 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 195/319] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:08 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:08.584749 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-fcf43eaa-fff4-43e5-933b-6bbabf9d0eef req-c2e3e28e-203c-4798-a172-dc2793affcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03811f1-6242-47b2-be06-1ed656918ccb", "tag": "53f23a0e-d315-46e7-8373-2a51593bddbf"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:08.586225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:08.586225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:08.593319 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-fcf43eaa-fff4-43e5-933b-6bbabf9d0eef req-c2e3e28e-203c-4798-a172-dc2793affcb5 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:08.593650 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-fcf43eaa-fff4-43e5-933b-6bbabf9d0eef req-c2e3e28e-203c-4798-a172-dc2793affcb5 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:08.606556 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-fcf43eaa-fff4-43e5-933b-6bbabf9d0eef req-c2e3e28e-203c-4798-a172-dc2793affcb5 service nova] Creating event network-changed:53f23a0e-d315-46e7-8373-2a51593bddbf for instance d03811f1-6242-47b2-be06-1ed656918ccb on hv-cinder-81764 Nov 11 20:40:08.611542 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-fcf43eaa-fff4-43e5-933b-6bbabf9d0eef req-c2e3e28e-203c-4798-a172-dc2793affcb5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030156 Nov 11 20:40:08.612471 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 196/320] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:08.618652 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6b8f0d70-7101-4400-abe1-72e8075bc9fd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:08.619576 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6b8f0d70-7101-4400-abe1-72e8075bc9fd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:08.626479 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6b8f0d70-7101-4400-abe1-72e8075bc9fd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:08.627134 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6b8f0d70-7101-4400-abe1-72e8075bc9fd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:08.628152 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6b8f0d70-7101-4400-abe1-72e8075bc9fd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:08.628893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6b8f0d70-7101-4400-abe1-72e8075bc9fd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:08.875153 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-73358e93-f768-4dd5-96d9-89b427a267bd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:08.884223 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-73358e93-f768-4dd5-96d9-89b427a267bd tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.448514 Nov 11 20:40:08.884825 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 125/321] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:08 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:08.927380 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d020bb1e-ccc9-469e-839e-3a8e5c0f7be0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:08.928716 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d020bb1e-ccc9-469e-839e-3a8e5c0f7be0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:08.936513 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d020bb1e-ccc9-469e-839e-3a8e5c0f7be0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:08.937285 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d020bb1e-ccc9-469e-839e-3a8e5c0f7be0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:08.938302 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d020bb1e-ccc9-469e-839e-3a8e5c0f7be0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:08.939247 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d020bb1e-ccc9-469e-839e-3a8e5c0f7be0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:09.026872 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6b8f0d70-7101-4400-abe1-72e8075bc9fd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:09.036062 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6b8f0d70-7101-4400-abe1-72e8075bc9fd tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.420942 Nov 11 20:40:09.037062 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 197/322] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:08 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:09.272056 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-91c1765f-bae7-4ba8-8557-d56b4d6a95e9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:09.273433 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-91c1765f-bae7-4ba8-8557-d56b4d6a95e9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:09.290907 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-91c1765f-bae7-4ba8-8557-d56b4d6a95e9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:09.291373 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-91c1765f-bae7-4ba8-8557-d56b4d6a95e9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:09.292229 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-91c1765f-bae7-4ba8-8557-d56b4d6a95e9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:09.292647 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-91c1765f-bae7-4ba8-8557-d56b4d6a95e9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:09.306904 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d020bb1e-ccc9-469e-839e-3a8e5c0f7be0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:09.319068 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d020bb1e-ccc9-469e-839e-3a8e5c0f7be0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1314 microversion: 2.1 time: 0.395818 Nov 11 20:40:09.331373 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 126/323] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:08 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:09.337197 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-e44a2b09-999b-4604-9a8e-dfafcb6a7c2a req-0cfcd578-0da6-43fa-a9cf-cf499976c4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bded2955-e01c-44b7-8296-944f839f06b9", "name": "network-vif-plugged", "status": "completed", "tag": "29fa7464-b08b-4f56-89c0-b86091d4eb50"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:09.339418 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:09.339418 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:40:09.347148 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-e44a2b09-999b-4604-9a8e-dfafcb6a7c2a req-0cfcd578-0da6-43fa-a9cf-cf499976c4e8 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:09.347887 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-e44a2b09-999b-4604-9a8e-dfafcb6a7c2a req-0cfcd578-0da6-43fa-a9cf-cf499976c4e8 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:09.360349 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-e44a2b09-999b-4604-9a8e-dfafcb6a7c2a req-0cfcd578-0da6-43fa-a9cf-cf499976c4e8 service nova] Creating event network-vif-plugged:29fa7464-b08b-4f56-89c0-b86091d4eb50 for instance bded2955-e01c-44b7-8296-944f839f06b9 on hv-cinder-81764 Nov 11 20:40:09.367655 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-e44a2b09-999b-4604-9a8e-dfafcb6a7c2a req-0cfcd578-0da6-43fa-a9cf-cf499976c4e8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034671 Nov 11 20:40:09.368450 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 127/324] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:09.433522 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f2267361-5cfa-43a0-ab87-cd9d96c20b6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:09.437643 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f2267361-5cfa-43a0-ab87-cd9d96c20b6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:09.448989 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f2267361-5cfa-43a0-ab87-cd9d96c20b6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:09.449923 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f2267361-5cfa-43a0-ab87-cd9d96c20b6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:09.451387 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f2267361-5cfa-43a0-ab87-cd9d96c20b6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:09.452061 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f2267361-5cfa-43a0-ab87-cd9d96c20b6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:09.597581 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f2267361-5cfa-43a0-ab87-cd9d96c20b6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28218 microversion: 2.20 time: 0.170557 Nov 11 20:40:09.598553 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 128/325] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:09 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:09.610452 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9d31ee6a-73be-4310-8fa7-052e821d2c36 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:09.612231 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9d31ee6a-73be-4310-8fa7-052e821d2c36 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:09.625362 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9d31ee6a-73be-4310-8fa7-052e821d2c36 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:09.626776 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9d31ee6a-73be-4310-8fa7-052e821d2c36 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:09.628350 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9d31ee6a-73be-4310-8fa7-052e821d2c36 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:09.629391 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9d31ee6a-73be-4310-8fa7-052e821d2c36 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:09.678672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-91c1765f-bae7-4ba8-8557-d56b4d6a95e9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:09.691247 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-91c1765f-bae7-4ba8-8557-d56b4d6a95e9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1363 microversion: 2.1 time: 0.427912 Nov 11 20:40:09.694954 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 198/326] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:09 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1363 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:09.703673 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9515508b-711b-487a-9e89-878d6d1a594d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:09.706747 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9515508b-711b-487a-9e89-878d6d1a594d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:09.723736 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9515508b-711b-487a-9e89-878d6d1a594d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:09.724420 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9515508b-711b-487a-9e89-878d6d1a594d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:09.725327 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9515508b-711b-487a-9e89-878d6d1a594d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:09.725889 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9515508b-711b-487a-9e89-878d6d1a594d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:10.232252 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9d31ee6a-73be-4310-8fa7-052e821d2c36 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:10.239602 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9515508b-711b-487a-9e89-878d6d1a594d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:10.239931 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9d31ee6a-73be-4310-8fa7-052e821d2c36 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.639804 Nov 11 20:40:10.240531 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 129/327] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:09 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:10.244930 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a793a7a0-4c00-455e-ac74-5f7e2f95edd5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:10.245707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a793a7a0-4c00-455e-ac74-5f7e2f95edd5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:10.251604 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a793a7a0-4c00-455e-ac74-5f7e2f95edd5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:10.252077 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a793a7a0-4c00-455e-ac74-5f7e2f95edd5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:10.252901 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a793a7a0-4c00-455e-ac74-5f7e2f95edd5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:10.253332 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a793a7a0-4c00-455e-ac74-5f7e2f95edd5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:10.256536 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9515508b-711b-487a-9e89-878d6d1a594d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1314 microversion: 2.1 time: 0.560374 Nov 11 20:40:10.257325 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 199/328] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:09 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:10.262083 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1c91ec58-e864-451a-b392-bdfaaf20b4ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:10.262803 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1c91ec58-e864-451a-b392-bdfaaf20b4ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:10.268865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1c91ec58-e864-451a-b392-bdfaaf20b4ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:10.269420 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1c91ec58-e864-451a-b392-bdfaaf20b4ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:10.270905 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1c91ec58-e864-451a-b392-bdfaaf20b4ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:10.271463 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1c91ec58-e864-451a-b392-bdfaaf20b4ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:10.550506 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a793a7a0-4c00-455e-ac74-5f7e2f95edd5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:10.562127 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a793a7a0-4c00-455e-ac74-5f7e2f95edd5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.320307 Nov 11 20:40:10.573661 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 130/329] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:10 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:10.578859 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1eee2f7f-42dc-44f7-bcf1-dd12bf7e73b5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:10.579771 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1eee2f7f-42dc-44f7-bcf1-dd12bf7e73b5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:10.586671 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1eee2f7f-42dc-44f7-bcf1-dd12bf7e73b5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:10.587438 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1eee2f7f-42dc-44f7-bcf1-dd12bf7e73b5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:10.589044 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1eee2f7f-42dc-44f7-bcf1-dd12bf7e73b5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:10.589692 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1eee2f7f-42dc-44f7-bcf1-dd12bf7e73b5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:10.596362 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1c91ec58-e864-451a-b392-bdfaaf20b4ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:10.617852 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1c91ec58-e864-451a-b392-bdfaaf20b4ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.359054 Nov 11 20:40:10.618615 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 200/330] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:10 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:10.628028 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f48c92a7-a91e-49e2-a276-d9d05fcba24e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:10.630488 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f48c92a7-a91e-49e2-a276-d9d05fcba24e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:10.638672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f48c92a7-a91e-49e2-a276-d9d05fcba24e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:10.639182 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f48c92a7-a91e-49e2-a276-d9d05fcba24e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:10.640315 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f48c92a7-a91e-49e2-a276-d9d05fcba24e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:10.640745 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f48c92a7-a91e-49e2-a276-d9d05fcba24e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:10.788450 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f48c92a7-a91e-49e2-a276-d9d05fcba24e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28508 microversion: 2.20 time: 0.166243 Nov 11 20:40:10.789092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 201/331] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:10 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:10.794119 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d4dd7bac-867d-46c0-addd-aa76e07c63c3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:10.794805 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d4dd7bac-867d-46c0-addd-aa76e07c63c3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:10.802692 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d4dd7bac-867d-46c0-addd-aa76e07c63c3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:10.803401 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d4dd7bac-867d-46c0-addd-aa76e07c63c3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:10.804257 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d4dd7bac-867d-46c0-addd-aa76e07c63c3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:10.804700 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d4dd7bac-867d-46c0-addd-aa76e07c63c3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:11.180573 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-1eee2f7f-42dc-44f7-bcf1-dd12bf7e73b5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:11.188177 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1eee2f7f-42dc-44f7-bcf1-dd12bf7e73b5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1314 microversion: 2.1 time: 0.613041 Nov 11 20:40:11.197793 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 131/332] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:10 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:11.203574 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-2965010a-ac23-4ff8-baad-c1839086f17a req-1d518f3f-5fe9-4806-b685-b5eb73fc0767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f94aca5-1944-4a8d-99f9-ad3407734fed", "tag": "11f2000a-1143-430a-b241-6ba0551ca4a1"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:11.205522 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:11.205522 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:40:11.214587 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-2965010a-ac23-4ff8-baad-c1839086f17a req-1d518f3f-5fe9-4806-b685-b5eb73fc0767 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:11.215096 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-2965010a-ac23-4ff8-baad-c1839086f17a req-1d518f3f-5fe9-4806-b685-b5eb73fc0767 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:11.228202 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-2965010a-ac23-4ff8-baad-c1839086f17a req-1d518f3f-5fe9-4806-b685-b5eb73fc0767 service nova] Creating event network-changed:11f2000a-1143-430a-b241-6ba0551ca4a1 for instance 5f94aca5-1944-4a8d-99f9-ad3407734fed on hv-cinder-81764 Nov 11 20:40:11.234134 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-2965010a-ac23-4ff8-baad-c1839086f17a req-1d518f3f-5fe9-4806-b685-b5eb73fc0767 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034678 Nov 11 20:40:11.234815 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 132/333] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:11.256603 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b1593aec-1875-4505-a607-13a0c2186901 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:11.257760 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b1593aec-1875-4505-a607-13a0c2186901 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:11.264544 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b1593aec-1875-4505-a607-13a0c2186901 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:11.264990 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b1593aec-1875-4505-a607-13a0c2186901 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:11.265763 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b1593aec-1875-4505-a607-13a0c2186901 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:11.266351 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b1593aec-1875-4505-a607-13a0c2186901 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:11.333938 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d4dd7bac-867d-46c0-addd-aa76e07c63c3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:11.341904 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d4dd7bac-867d-46c0-addd-aa76e07c63c3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1363 microversion: 2.1 time: 0.551617 Nov 11 20:40:11.342804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 202/334] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:10 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1363 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:11.347371 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a76253a7-c539-4675-8144-4ce54d6f6931 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:11.348825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a76253a7-c539-4675-8144-4ce54d6f6931 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:11.355145 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a76253a7-c539-4675-8144-4ce54d6f6931 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:11.355598 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a76253a7-c539-4675-8144-4ce54d6f6931 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:11.356461 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a76253a7-c539-4675-8144-4ce54d6f6931 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:11.357011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a76253a7-c539-4675-8144-4ce54d6f6931 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:11.669189 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b1593aec-1875-4505-a607-13a0c2186901 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:11.677366 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b1593aec-1875-4505-a607-13a0c2186901 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1318 microversion: 2.1 time: 0.425385 Nov 11 20:40:11.677966 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 133/335] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:11 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:11.688652 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b7f74b65-6c0d-4a06-8354-7d3817118316 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:11.689727 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b7f74b65-6c0d-4a06-8354-7d3817118316 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:11.695924 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b7f74b65-6c0d-4a06-8354-7d3817118316 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:11.696657 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b7f74b65-6c0d-4a06-8354-7d3817118316 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:11.697477 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b7f74b65-6c0d-4a06-8354-7d3817118316 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:11.697911 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b7f74b65-6c0d-4a06-8354-7d3817118316 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:11.700695 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a76253a7-c539-4675-8144-4ce54d6f6931 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:11.708143 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a76253a7-c539-4675-8144-4ce54d6f6931 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1314 microversion: 2.1 time: 0.364296 Nov 11 20:40:11.708956 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 203/336] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:11 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:11.721840 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-46ff0d64-2475-4cf1-b907-1466573dfdf1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:11.723705 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-46ff0d64-2475-4cf1-b907-1466573dfdf1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:11.731019 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-46ff0d64-2475-4cf1-b907-1466573dfdf1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:11.731720 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-46ff0d64-2475-4cf1-b907-1466573dfdf1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:11.733274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-46ff0d64-2475-4cf1-b907-1466573dfdf1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:11.733886 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-46ff0d64-2475-4cf1-b907-1466573dfdf1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:12.016796 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b7f74b65-6c0d-4a06-8354-7d3817118316 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:12.025905 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b7f74b65-6c0d-4a06-8354-7d3817118316 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.346775 Nov 11 20:40:12.036148 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 134/337] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:11 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:12.041977 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ad204909-1aad-4a26-b213-d77b54edbd5a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:12.043047 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ad204909-1aad-4a26-b213-d77b54edbd5a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:12.050234 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ad204909-1aad-4a26-b213-d77b54edbd5a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:12.050890 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ad204909-1aad-4a26-b213-d77b54edbd5a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:12.051825 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ad204909-1aad-4a26-b213-d77b54edbd5a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:12.052901 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ad204909-1aad-4a26-b213-d77b54edbd5a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:12.061861 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-46ff0d64-2475-4cf1-b907-1466573dfdf1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:12.080311 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-46ff0d64-2475-4cf1-b907-1466573dfdf1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.369431 Nov 11 20:40:12.080864 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 204/338] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:11 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:12.200272 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ad204909-1aad-4a26-b213-d77b54edbd5a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28508 microversion: 2.20 time: 0.161991 Nov 11 20:40:12.201167 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 135/339] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:12 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:12.205549 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7bc80d36-cce7-4050-91fa-c78b0add19de tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:12.206168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7bc80d36-cce7-4050-91fa-c78b0add19de tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:12.212676 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7bc80d36-cce7-4050-91fa-c78b0add19de tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:12.213124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7bc80d36-cce7-4050-91fa-c78b0add19de tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:12.213904 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7bc80d36-cce7-4050-91fa-c78b0add19de tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:12.214348 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7bc80d36-cce7-4050-91fa-c78b0add19de tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:12.359002 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4dc8c881-235d-4766-ba99-617bacaf8122 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:12.359686 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4dc8c881-235d-4766-ba99-617bacaf8122 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:12.367650 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4dc8c881-235d-4766-ba99-617bacaf8122 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:12.368559 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4dc8c881-235d-4766-ba99-617bacaf8122 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:12.369381 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4dc8c881-235d-4766-ba99-617bacaf8122 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:12.370053 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4dc8c881-235d-4766-ba99-617bacaf8122 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:12.437203 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7bc80d36-cce7-4050-91fa-c78b0add19de tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:12.446002 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7bc80d36-cce7-4050-91fa-c78b0add19de tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1314 microversion: 2.1 time: 0.244316 Nov 11 20:40:12.446587 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 205/340] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:12 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:12.580343 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-4dc8c881-235d-4766-ba99-617bacaf8122 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:12.588137 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4dc8c881-235d-4766-ba99-617bacaf8122 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1363 microversion: 2.1 time: 0.233201 Nov 11 20:40:12.588703 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 136/341] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:12 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:12.695547 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-40d03b5f-a5aa-4b24-b681-fc5201c18d73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:12.696314 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-40d03b5f-a5aa-4b24-b681-fc5201c18d73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:12.702809 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-40d03b5f-a5aa-4b24-b681-fc5201c18d73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:12.703258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-40d03b5f-a5aa-4b24-b681-fc5201c18d73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:12.704256 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-40d03b5f-a5aa-4b24-b681-fc5201c18d73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:12.704757 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-40d03b5f-a5aa-4b24-b681-fc5201c18d73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:12.728251 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-65424a12-011a-45b3-a6f0-ec951d60dcd7 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:12.728852 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-65424a12-011a-45b3-a6f0-ec951d60dcd7 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:12.735459 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-65424a12-011a-45b3-a6f0-ec951d60dcd7 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:12.736126 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-65424a12-011a-45b3-a6f0-ec951d60dcd7 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:12.737193 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-65424a12-011a-45b3-a6f0-ec951d60dcd7 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:12.737632 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-65424a12-011a-45b3-a6f0-ec951d60dcd7 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:12.985707 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-40d03b5f-a5aa-4b24-b681-fc5201c18d73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:13.002623 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-40d03b5f-a5aa-4b24-b681-fc5201c18d73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1507 microversion: 2.1 time: 0.311922 Nov 11 20:40:13.003524 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 206/342] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:12 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:13.013248 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-65424a12-011a-45b3-a6f0-ec951d60dcd7 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:13.018641 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-46f1c684-add7-4ce3-980d-87fc123f306e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "228e8e4e-b464-4d56-8e71-fdf7daf0ba61"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:13.019796 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-46f1c684-add7-4ce3-980d-87fc123f306e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:13.021328 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-65424a12-011a-45b3-a6f0-ec951d60dcd7 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1314 microversion: 2.1 time: 0.296716 Nov 11 20:40:13.022265 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 137/343] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:12 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:13.026061 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-46f1c684-add7-4ce3-980d-87fc123f306e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.026590 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-46f1c684-add7-4ce3-980d-87fc123f306e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.027468 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-46f1c684-add7-4ce3-980d-87fc123f306e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.027938 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-46f1c684-add7-4ce3-980d-87fc123f306e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.043610 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fa3b269b-aae3-49ec-9ef8-0d146e68b6de tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:13.044234 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fa3b269b-aae3-49ec-9ef8-0d146e68b6de tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:13.049997 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa3b269b-aae3-49ec-9ef8-0d146e68b6de tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.051911 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa3b269b-aae3-49ec-9ef8-0d146e68b6de tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.052902 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa3b269b-aae3-49ec-9ef8-0d146e68b6de tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.053345 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa3b269b-aae3-49ec-9ef8-0d146e68b6de tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.125207 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-46f1c684-add7-4ce3-980d-87fc123f306e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] HTTP exception thrown: Invalid volume: volume 228e8e4e-b464-4d56-8e71-fdf7daf0ba61 is already attached to instances: aa2a29b9-345d-48ed-ab58-999c80cd44d8 Nov 11 20:40:13.125930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-46f1c684-add7-4ce3-980d-87fc123f306e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Returning 400 to user: Invalid volume: volume 228e8e4e-b464-4d56-8e71-fdf7daf0ba61 is already attached to instances: aa2a29b9-345d-48ed-ab58-999c80cd44d8 {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:40:13.127513 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-46f1c684-add7-4ce3-980d-87fc123f306e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "POST /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111940 Nov 11 20:40:13.131874 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 207/344] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:40:13 2021] POST /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 11 20:40:13.139177 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f96e8e46-23cd-49c5-bc2c-2e2954b8907f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:13.139958 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f96e8e46-23cd-49c5-bc2c-2e2954b8907f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:13.166580 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f96e8e46-23cd-49c5-bc2c-2e2954b8907f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.167114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f96e8e46-23cd-49c5-bc2c-2e2954b8907f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.167925 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f96e8e46-23cd-49c5-bc2c-2e2954b8907f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.168388 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f96e8e46-23cd-49c5-bc2c-2e2954b8907f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.238146 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-fa3b269b-aae3-49ec-9ef8-0d146e68b6de tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:13.248463 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fa3b269b-aae3-49ec-9ef8-0d146e68b6de tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.209254 Nov 11 20:40:13.250404 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 138/345] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:13 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:13.266410 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fad926d6-db9c-4709-b7da-23af1e762065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:13.267608 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fad926d6-db9c-4709-b7da-23af1e762065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:13.274343 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fad926d6-db9c-4709-b7da-23af1e762065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.274789 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fad926d6-db9c-4709-b7da-23af1e762065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.275570 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fad926d6-db9c-4709-b7da-23af1e762065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.280581 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fad926d6-db9c-4709-b7da-23af1e762065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.385788 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f96e8e46-23cd-49c5-bc2c-2e2954b8907f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:13.394509 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f96e8e46-23cd-49c5-bc2c-2e2954b8907f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.261549 Nov 11 20:40:13.395826 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 208/346] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:13 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:13.401145 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-992ec7c1-5ecb-47b0-ba0c-ad736f1ed2db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:13.401873 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-992ec7c1-5ecb-47b0-ba0c-ad736f1ed2db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:13.408554 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-992ec7c1-5ecb-47b0-ba0c-ad736f1ed2db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.409310 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-992ec7c1-5ecb-47b0-ba0c-ad736f1ed2db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.411216 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-992ec7c1-5ecb-47b0-ba0c-ad736f1ed2db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.411954 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-992ec7c1-5ecb-47b0-ba0c-ad736f1ed2db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.413214 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fad926d6-db9c-4709-b7da-23af1e762065 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28559 microversion: 2.20 time: 0.160478 Nov 11 20:40:13.415630 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 139/347] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:13 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:13.427996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-2da17445-18c9-4d37-84b0-f0817f82b994 req-5c3593f1-a6c4-430c-af9b-794b332c8666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b5e5fb-4793-4495-a93b-321835ecf1b3", "name": "network-vif-plugged", "status": "completed", "tag": "b01233b4-ce9c-4445-81a3-554fbf132f2f"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:13.430114 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:13.430114 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:40:13.439868 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-2da17445-18c9-4d37-84b0-f0817f82b994 req-5c3593f1-a6c4-430c-af9b-794b332c8666 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.440486 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-2da17445-18c9-4d37-84b0-f0817f82b994 req-5c3593f1-a6c4-430c-af9b-794b332c8666 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.456472 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-2da17445-18c9-4d37-84b0-f0817f82b994 req-5c3593f1-a6c4-430c-af9b-794b332c8666 service nova] Creating event network-vif-plugged:b01233b4-ce9c-4445-81a3-554fbf132f2f for instance 09b5e5fb-4793-4495-a93b-321835ecf1b3 on hv-cinder-81764 Nov 11 20:40:13.463601 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-2da17445-18c9-4d37-84b0-f0817f82b994 req-5c3593f1-a6c4-430c-af9b-794b332c8666 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045581 Nov 11 20:40:13.464630 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 140/348] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:13.470201 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fff9f46c-5316-4391-aa5a-ec7745071dc3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:13.471097 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fff9f46c-5316-4391-aa5a-ec7745071dc3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:13.480992 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fff9f46c-5316-4391-aa5a-ec7745071dc3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.481720 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fff9f46c-5316-4391-aa5a-ec7745071dc3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.482887 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fff9f46c-5316-4391-aa5a-ec7745071dc3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.483502 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fff9f46c-5316-4391-aa5a-ec7745071dc3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.656995 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-992ec7c1-5ecb-47b0-ba0c-ad736f1ed2db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lazy-loading 'services' on Instance uuid aa2a29b9-345d-48ed-ab58-999c80cd44d8 {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:40:13.699633 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-fff9f46c-5316-4391-aa5a-ec7745071dc3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:13.722647 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fff9f46c-5316-4391-aa5a-ec7745071dc3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1314 microversion: 2.1 time: 0.256519 Nov 11 20:40:13.723743 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 141/349] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:13 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:13.737354 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9ece8114-a632-480e-b9ab-237be86d5023 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:13.738149 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9ece8114-a632-480e-b9ab-237be86d5023 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:13.745296 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9ece8114-a632-480e-b9ab-237be86d5023 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.746020 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9ece8114-a632-480e-b9ab-237be86d5023 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.747020 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9ece8114-a632-480e-b9ab-237be86d5023 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.747512 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9ece8114-a632-480e-b9ab-237be86d5023 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.817625 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-992ec7c1-5ecb-47b0-ba0c-ad736f1ed2db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8/os-volume_attachments/228e8e4e-b464-4d56-8e71-fdf7daf0ba61" status: 202 len: 0 microversion: 2.1 time: 0.419077 Nov 11 20:40:13.818732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 209/350] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Nov 11 20:40:13 2021] DELETE /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8/os-volume_attachments/228e8e4e-b464-4d56-8e71-fdf7daf0ba61 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:13.827570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0ba6778a-296a-4ace-a03b-5bd8cdda2c35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:13.828812 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0ba6778a-296a-4ace-a03b-5bd8cdda2c35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:13.839529 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ba6778a-296a-4ace-a03b-5bd8cdda2c35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.840277 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ba6778a-296a-4ace-a03b-5bd8cdda2c35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.843481 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ba6778a-296a-4ace-a03b-5bd8cdda2c35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:13.845208 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ba6778a-296a-4ace-a03b-5bd8cdda2c35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:13.887421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0ba6778a-296a-4ace-a03b-5bd8cdda2c35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064041 Nov 11 20:40:13.888140 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 210/351] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:40:13 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:13.942290 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9ece8114-a632-480e-b9ab-237be86d5023 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:13.951438 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9ece8114-a632-480e-b9ab-237be86d5023 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1363 microversion: 2.1 time: 0.225355 Nov 11 20:40:13.952317 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 142/352] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:13 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:14.039199 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ca87e115-0ee5-44f9-89fc-7f24d8e07dda tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:14.040191 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ca87e115-0ee5-44f9-89fc-7f24d8e07dda tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:14.046964 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca87e115-0ee5-44f9-89fc-7f24d8e07dda tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.047472 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca87e115-0ee5-44f9-89fc-7f24d8e07dda tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.048505 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca87e115-0ee5-44f9-89fc-7f24d8e07dda tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.048955 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca87e115-0ee5-44f9-89fc-7f24d8e07dda tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.187715 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ca87e115-0ee5-44f9-89fc-7f24d8e07dda tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:14.198021 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ca87e115-0ee5-44f9-89fc-7f24d8e07dda tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1314 microversion: 2.1 time: 0.163414 Nov 11 20:40:14.198586 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 211/353] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:14 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:14.266427 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a65aeefd-40ee-4313-ac4e-363fca61b018 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:14.267035 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a65aeefd-40ee-4313-ac4e-363fca61b018 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:14.273610 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a65aeefd-40ee-4313-ac4e-363fca61b018 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.274057 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a65aeefd-40ee-4313-ac4e-363fca61b018 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.274842 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a65aeefd-40ee-4313-ac4e-363fca61b018 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.275305 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a65aeefd-40ee-4313-ac4e-363fca61b018 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.407210 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a65aeefd-40ee-4313-ac4e-363fca61b018 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:14.411929 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bab2bd69-23d4-41e0-a36f-9e6bf9333448 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:14.412563 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-bab2bd69-23d4-41e0-a36f-9e6bf9333448 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:14.415311 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a65aeefd-40ee-4313-ac4e-363fca61b018 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.152487 Nov 11 20:40:14.415874 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 143/354] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:14 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:14.418391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bab2bd69-23d4-41e0-a36f-9e6bf9333448 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.418893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bab2bd69-23d4-41e0-a36f-9e6bf9333448 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.419680 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bab2bd69-23d4-41e0-a36f-9e6bf9333448 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.420146 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bab2bd69-23d4-41e0-a36f-9e6bf9333448 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.425323 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4149cd57-a1fa-42ef-b8b1-94582d991f2c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:14.426437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4149cd57-a1fa-42ef-b8b1-94582d991f2c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:14.432268 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4149cd57-a1fa-42ef-b8b1-94582d991f2c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.432710 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4149cd57-a1fa-42ef-b8b1-94582d991f2c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.433484 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4149cd57-a1fa-42ef-b8b1-94582d991f2c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.433916 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4149cd57-a1fa-42ef-b8b1-94582d991f2c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.561012 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4149cd57-a1fa-42ef-b8b1-94582d991f2c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28676 microversion: 2.20 time: 0.138764 Nov 11 20:40:14.561865 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 144/355] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:14 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28676 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:40:14.565098 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-bab2bd69-23d4-41e0-a36f-9e6bf9333448 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:14.574505 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bab2bd69-23d4-41e0-a36f-9e6bf9333448 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.166756 Nov 11 20:40:14.575067 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 212/356] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:14 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:14.740803 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-894554a5-6740-4645-b671-f1c7e0733407 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:14.741483 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-894554a5-6740-4645-b671-f1c7e0733407 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:14.748249 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-894554a5-6740-4645-b671-f1c7e0733407 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.748701 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-894554a5-6740-4645-b671-f1c7e0733407 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.749483 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-894554a5-6740-4645-b671-f1c7e0733407 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.749916 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-894554a5-6740-4645-b671-f1c7e0733407 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.889846 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-894554a5-6740-4645-b671-f1c7e0733407 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:14.898807 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-894554a5-6740-4645-b671-f1c7e0733407 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1314 microversion: 2.1 time: 0.161921 Nov 11 20:40:14.898947 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a2fa7960-3895-4c2b-9291-5dd828221534 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:14.899673 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 145/357] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:14 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:14.899855 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a2fa7960-3895-4c2b-9291-5dd828221534 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:14.906518 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a2fa7960-3895-4c2b-9291-5dd828221534 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.906966 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a2fa7960-3895-4c2b-9291-5dd828221534 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.907767 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a2fa7960-3895-4c2b-9291-5dd828221534 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.908225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a2fa7960-3895-4c2b-9291-5dd828221534 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.969489 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e33361eb-a24c-4360-8a54-40bf2320c576 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:14.970366 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e33361eb-a24c-4360-8a54-40bf2320c576 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:14.977355 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e33361eb-a24c-4360-8a54-40bf2320c576 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.980616 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e33361eb-a24c-4360-8a54-40bf2320c576 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:14.981734 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e33361eb-a24c-4360-8a54-40bf2320c576 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:14.985788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e33361eb-a24c-4360-8a54-40bf2320c576 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:15.095719 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a2fa7960-3895-4c2b-9291-5dd828221534 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200424 Nov 11 20:40:15.099281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 213/358] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:40:14 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:40:15.145506 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e33361eb-a24c-4360-8a54-40bf2320c576 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:15.153555 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e33361eb-a24c-4360-8a54-40bf2320c576 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1363 microversion: 2.1 time: 0.188673 Nov 11 20:40:15.154255 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 146/359] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:14 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:15.214386 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ac9d4acf-b3b4-4454-8a6a-9c164d31c2ce tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:15.216344 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ac9d4acf-b3b4-4454-8a6a-9c164d31c2ce tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:15.221011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ac9d4acf-b3b4-4454-8a6a-9c164d31c2ce tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:15.221453 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ac9d4acf-b3b4-4454-8a6a-9c164d31c2ce tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:15.222229 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ac9d4acf-b3b4-4454-8a6a-9c164d31c2ce tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:15.222656 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ac9d4acf-b3b4-4454-8a6a-9c164d31c2ce tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:15.367708 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ac9d4acf-b3b4-4454-8a6a-9c164d31c2ce tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:15.374890 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ac9d4acf-b3b4-4454-8a6a-9c164d31c2ce tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1314 microversion: 2.1 time: 0.164145 Nov 11 20:40:15.375445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 214/360] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:15 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:15.432385 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b180dd06-ef3a-4c99-aba9-cb8f08a5dc0e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:15.433012 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b180dd06-ef3a-4c99-aba9-cb8f08a5dc0e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:15.439519 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b180dd06-ef3a-4c99-aba9-cb8f08a5dc0e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:15.440045 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b180dd06-ef3a-4c99-aba9-cb8f08a5dc0e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:15.440822 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b180dd06-ef3a-4c99-aba9-cb8f08a5dc0e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:15.441255 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b180dd06-ef3a-4c99-aba9-cb8f08a5dc0e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:15.499430 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-cf608055-dfb5-4b31-97ee-f810fbe1feb5 req-30d86f9e-4725-4c55-a12b-db4e6adef9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28d94ff-cfbb-46b3-b20d-32a6cb35893e", "name": "network-vif-plugged", "status": "completed", "tag": "30542ce7-fdf6-41e0-981e-8ee1bf98723f"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:15.500970 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:15.500970 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:15.509589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-cf608055-dfb5-4b31-97ee-f810fbe1feb5 req-30d86f9e-4725-4c55-a12b-db4e6adef9b7 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:15.510144 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-cf608055-dfb5-4b31-97ee-f810fbe1feb5 req-30d86f9e-4725-4c55-a12b-db4e6adef9b7 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:15.523336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-cf608055-dfb5-4b31-97ee-f810fbe1feb5 req-30d86f9e-4725-4c55-a12b-db4e6adef9b7 service nova] Creating event network-vif-plugged:30542ce7-fdf6-41e0-981e-8ee1bf98723f for instance d28d94ff-cfbb-46b3-b20d-32a6cb35893e on hv-cinder-81764 Nov 11 20:40:15.528581 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-cf608055-dfb5-4b31-97ee-f810fbe1feb5 req-30d86f9e-4725-4c55-a12b-db4e6adef9b7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032642 Nov 11 20:40:15.529159 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 215/361] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:40:15.575744 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8a4bec67-f3ac-4a1d-ae16-657578e85a7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:15.577197 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8a4bec67-f3ac-4a1d-ae16-657578e85a7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:15.585168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8a4bec67-f3ac-4a1d-ae16-657578e85a7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:15.585738 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8a4bec67-f3ac-4a1d-ae16-657578e85a7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:15.586234 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b180dd06-ef3a-4c99-aba9-cb8f08a5dc0e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:15.586571 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8a4bec67-f3ac-4a1d-ae16-657578e85a7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:15.587190 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8a4bec67-f3ac-4a1d-ae16-657578e85a7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:15.593900 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b180dd06-ef3a-4c99-aba9-cb8f08a5dc0e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.165085 Nov 11 20:40:15.594527 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 147/362] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:15 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:15.600026 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0a49a057-c0b9-4999-bd96-6112470c7111 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:15.600864 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0a49a057-c0b9-4999-bd96-6112470c7111 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:15.606929 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a49a057-c0b9-4999-bd96-6112470c7111 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:15.607679 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a49a057-c0b9-4999-bd96-6112470c7111 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:15.608806 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a49a057-c0b9-4999-bd96-6112470c7111 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:15.609475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a49a057-c0b9-4999-bd96-6112470c7111 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:15.684418 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8a4bec67-f3ac-4a1d-ae16-657578e85a7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28676 microversion: 2.20 time: 0.113838 Nov 11 20:40:15.685066 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 216/363] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:15 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28676 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:40:15.769325 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0a49a057-c0b9-4999-bd96-6112470c7111 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:15.777643 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0a49a057-c0b9-4999-bd96-6112470c7111 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.181911 Nov 11 20:40:15.778199 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 148/364] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:15 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:15.919170 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d40a60af-1f09-4992-ad27-b99cdf779435 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:15.919870 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d40a60af-1f09-4992-ad27-b99cdf779435 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:15.928161 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d40a60af-1f09-4992-ad27-b99cdf779435 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:15.928760 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d40a60af-1f09-4992-ad27-b99cdf779435 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:15.929668 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d40a60af-1f09-4992-ad27-b99cdf779435 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:15.930274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d40a60af-1f09-4992-ad27-b99cdf779435 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:16.070765 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d40a60af-1f09-4992-ad27-b99cdf779435 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:16.078236 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d40a60af-1f09-4992-ad27-b99cdf779435 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1314 microversion: 2.1 time: 0.163236 Nov 11 20:40:16.078785 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 217/365] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:15 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:16.107088 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ab219987-c888-4e7c-bf9a-2449d2cc7e63 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:16.107846 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ab219987-c888-4e7c-bf9a-2449d2cc7e63 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:16.114871 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ab219987-c888-4e7c-bf9a-2449d2cc7e63 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:16.115315 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ab219987-c888-4e7c-bf9a-2449d2cc7e63 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:16.116124 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ab219987-c888-4e7c-bf9a-2449d2cc7e63 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:16.116555 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ab219987-c888-4e7c-bf9a-2449d2cc7e63 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:16.145850 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ab219987-c888-4e7c-bf9a-2449d2cc7e63 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042826 Nov 11 20:40:16.146614 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 149/366] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:40:16 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:16.175034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a66727f5-de30-42f6-812a-12995b454213 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:16.175034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a66727f5-de30-42f6-812a-12995b454213 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:16.182317 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a66727f5-de30-42f6-812a-12995b454213 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:16.182764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a66727f5-de30-42f6-812a-12995b454213 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:16.183692 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a66727f5-de30-42f6-812a-12995b454213 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:16.184314 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a66727f5-de30-42f6-812a-12995b454213 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:16.328524 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1438921427", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "networks": [{"uuid": "f75b74a3-4944-4e66-a1f1-0eb754745d66"}]}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:16.345276 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a66727f5-de30-42f6-812a-12995b454213 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:16.355959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a66727f5-de30-42f6-812a-12995b454213 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1363 microversion: 2.1 time: 0.186123 Nov 11 20:40:16.365072 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 218/367] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:16 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:16.393810 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-22752db4-236c-466c-961e-4df9c211efa0 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:16.396358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-22752db4-236c-466c-961e-4df9c211efa0 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:16.401122 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.network.neutron [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] validate_networks() for [('f75b74a3-4944-4e66-a1f1-0eb754745d66', None, None, None, None, None)] {{(pid=122527) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:40:16.403225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-22752db4-236c-466c-961e-4df9c211efa0 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:16.403675 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-22752db4-236c-466c-961e-4df9c211efa0 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:16.404683 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-22752db4-236c-466c-961e-4df9c211efa0 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:16.405130 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-22752db4-236c-466c-961e-4df9c211efa0 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:16.648968 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-22752db4-236c-466c-961e-4df9c211efa0 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:16.663258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-22752db4-236c-466c-961e-4df9c211efa0 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1314 microversion: 2.1 time: 0.275065 Nov 11 20:40:16.665391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 219/368] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:16 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:16.671342 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4137638d-2833-41af-b77e-89f6da669827 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:16.672310 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4137638d-2833-41af-b77e-89f6da669827 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:16.681699 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4137638d-2833-41af-b77e-89f6da669827 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:16.682211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4137638d-2833-41af-b77e-89f6da669827 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:16.683212 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4137638d-2833-41af-b77e-89f6da669827 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:16.683663 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4137638d-2833-41af-b77e-89f6da669827 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.222534 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4137638d-2833-41af-b77e-89f6da669827 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:17.231187 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4137638d-2833-41af-b77e-89f6da669827 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.563732 Nov 11 20:40:17.231759 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 220/369] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:16 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:17.252777 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1098a4d2-1eaa-4702-a7d4-bd5ee4f3e1db tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:17.254001 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1098a4d2-1eaa-4702-a7d4-bd5ee4f3e1db tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:17.255452 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Flavor limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:40:17.256524 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Image limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:40:17.257287 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Flavor pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:40:17.258629 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Image pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:40:17.259434 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:40:17.261506 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1098a4d2-1eaa-4702-a7d4-bd5ee4f3e1db tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.262319 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1098a4d2-1eaa-4702-a7d4-bd5ee4f3e1db tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.263210 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1098a4d2-1eaa-4702-a7d4-bd5ee4f3e1db tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.263717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1098a4d2-1eaa-4702-a7d4-bd5ee4f3e1db tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.276604 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.277193 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.278105 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.278633 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.304630 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Getting quotas for project 7b92a8a05c22447985ae53c7b9c91fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:40:17.309436 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Getting quotas for user f77c253d448e482db5ecbc453e4e0f3e and project 7b92a8a05c22447985ae53c7b9c91fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:40:17.326233 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Going to run 1 instances... {{(pid=122527) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:40:17.329691 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:40:17.385118 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1098a4d2-1eaa-4702-a7d4-bd5ee4f3e1db tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28676 microversion: 2.20 time: 0.152083 Nov 11 20:40:17.385691 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d2f06c89-d360-4f8d-a1d8-e3a579f44251 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060642 Nov 11 20:40:17.386251 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 150/370] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:40:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 11 20:40:17.390088 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 221/371] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:17 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:17.395848 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8ba42570-7e9d-4ef7-aef1-5d51474c702e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:17.396099 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d82e5ae3-c5b7-4a3a-89b0-0ec2f90bafc1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:17.396768 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8ba42570-7e9d-4ef7-aef1-5d51474c702e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:17.397156 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d82e5ae3-c5b7-4a3a-89b0-0ec2f90bafc1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:17.404372 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ba42570-7e9d-4ef7-aef1-5d51474c702e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.404811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ba42570-7e9d-4ef7-aef1-5d51474c702e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.405585 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ba42570-7e9d-4ef7-aef1-5d51474c702e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.406174 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ba42570-7e9d-4ef7-aef1-5d51474c702e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.407893 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d82e5ae3-c5b7-4a3a-89b0-0ec2f90bafc1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.408686 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d82e5ae3-c5b7-4a3a-89b0-0ec2f90bafc1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.410179 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d82e5ae3-c5b7-4a3a-89b0-0ec2f90bafc1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.411839 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d82e5ae3-c5b7-4a3a-89b0-0ec2f90bafc1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.633564 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d82e5ae3-c5b7-4a3a-89b0-0ec2f90bafc1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:17.642408 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d82e5ae3-c5b7-4a3a-89b0-0ec2f90bafc1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.254956 Nov 11 20:40:17.643398 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 151/372] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:17 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:17.656618 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8ba42570-7e9d-4ef7-aef1-5d51474c702e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:17.669629 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8ba42570-7e9d-4ef7-aef1-5d51474c702e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1499 microversion: 2.1 time: 0.278000 Nov 11 20:40:17.670804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 222/373] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:17 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1499 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:17.675075 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-de8a0800-afbe-4280-b4d6-80c20f0f5782 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:17.675686 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-de8a0800-afbe-4280-b4d6-80c20f0f5782 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:17.694742 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-de8a0800-afbe-4280-b4d6-80c20f0f5782 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.696149 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-de8a0800-afbe-4280-b4d6-80c20f0f5782 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.696246 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e176315c-a834-4613-b88f-539996c334d1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:17.696329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-de8a0800-afbe-4280-b4d6-80c20f0f5782 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.696329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-de8a0800-afbe-4280-b4d6-80c20f0f5782 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.696886 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e176315c-a834-4613-b88f-539996c334d1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:17.812406 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e176315c-a834-4613-b88f-539996c334d1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:17.820936 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e176315c-a834-4613-b88f-539996c334d1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1218 microversion: 2.1 time: 0.133708 Nov 11 20:40:17.831377 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 223/374] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:17 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:17.836682 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-75a64197-b41a-483f-8156-cc21a82243b0 req-7f53db38-2e2c-46cf-bb5b-34373e2c5dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03811f1-6242-47b2-be06-1ed656918ccb", "name": "network-vif-plugged", "status": "completed", "tag": "53f23a0e-d315-46e7-8373-2a51593bddbf"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:17.838411 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:17.838411 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:17.847117 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-75a64197-b41a-483f-8156-cc21a82243b0 req-7f53db38-2e2c-46cf-bb5b-34373e2c5dd6 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.847572 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-75a64197-b41a-483f-8156-cc21a82243b0 req-7f53db38-2e2c-46cf-bb5b-34373e2c5dd6 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.863017 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-75a64197-b41a-483f-8156-cc21a82243b0 req-7f53db38-2e2c-46cf-bb5b-34373e2c5dd6 service nova] Creating event network-vif-plugged:53f23a0e-d315-46e7-8373-2a51593bddbf for instance d03811f1-6242-47b2-be06-1ed656918ccb on hv-cinder-81764 Nov 11 20:40:17.872225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-75a64197-b41a-483f-8156-cc21a82243b0 req-7f53db38-2e2c-46cf-bb5b-34373e2c5dd6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039190 Nov 11 20:40:17.873063 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 224/375] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:17.878242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1bdce4e8-f926-4781-9baa-5abf7038fc05 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:17.879044 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1bdce4e8-f926-4781-9baa-5abf7038fc05 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:17.886791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1bdce4e8-f926-4781-9baa-5abf7038fc05 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.887667 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1bdce4e8-f926-4781-9baa-5abf7038fc05 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:17.888651 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1bdce4e8-f926-4781-9baa-5abf7038fc05 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:17.889243 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1bdce4e8-f926-4781-9baa-5abf7038fc05 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:18.106631 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-de8a0800-afbe-4280-b4d6-80c20f0f5782 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:18.116325 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-de8a0800-afbe-4280-b4d6-80c20f0f5782 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1363 microversion: 2.1 time: 0.461763 Nov 11 20:40:18.117456 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 152/376] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:17 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1363 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:18.250060 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5f5db154-aeb9-43f7-a9ab-d77a4fbb12ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:18.250575 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5f5db154-aeb9-43f7-a9ab-d77a4fbb12ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:18.261704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5f5db154-aeb9-43f7-a9ab-d77a4fbb12ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:18.262343 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5f5db154-aeb9-43f7-a9ab-d77a4fbb12ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:18.262932 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5f5db154-aeb9-43f7-a9ab-d77a4fbb12ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:18.263571 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5f5db154-aeb9-43f7-a9ab-d77a4fbb12ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:18.306864 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1bdce4e8-f926-4781-9baa-5abf7038fc05 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:18.323732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1bdce4e8-f926-4781-9baa-5abf7038fc05 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1314 microversion: 2.1 time: 0.448958 Nov 11 20:40:18.324409 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 225/377] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:17 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:18.351607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5bb7afb5-165b-4f43-8e0e-26a1771dfe06 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:18.352133 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5bb7afb5-165b-4f43-8e0e-26a1771dfe06 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:18.361184 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5bb7afb5-165b-4f43-8e0e-26a1771dfe06 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:18.362127 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5bb7afb5-165b-4f43-8e0e-26a1771dfe06 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:18.364989 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5bb7afb5-165b-4f43-8e0e-26a1771dfe06 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:18.367574 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5bb7afb5-165b-4f43-8e0e-26a1771dfe06 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:18.404686 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5bb7afb5-165b-4f43-8e0e-26a1771dfe06 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Going to try to terminate instance {{(pid=122526) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:40:18.521475 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5bb7afb5-165b-4f43-8e0e-26a1771dfe06 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "DELETE /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 204 len: 0 microversion: 2.1 time: 0.174236 Nov 11 20:40:18.522550 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 226/378] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:40:18 2021] DELETE /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:40:18.530121 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0d02734d-7b1a-4ba7-b837-82c5da92c1e2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:18.531364 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0d02734d-7b1a-4ba7-b837-82c5da92c1e2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:18.539033 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d02734d-7b1a-4ba7-b837-82c5da92c1e2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:18.539490 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d02734d-7b1a-4ba7-b837-82c5da92c1e2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:18.540330 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d02734d-7b1a-4ba7-b837-82c5da92c1e2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:18.541078 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d02734d-7b1a-4ba7-b837-82c5da92c1e2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:18.589340 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5f5db154-aeb9-43f7-a9ab-d77a4fbb12ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:18.596284 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5f5db154-aeb9-43f7-a9ab-d77a4fbb12ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1358 microversion: 2.1 time: 0.350199 Nov 11 20:40:18.596851 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 153/379] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:18 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:18.601568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-07276772-0b72-4e1f-9701-fbc0ec6f503f tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:18.602169 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-07276772-0b72-4e1f-9701-fbc0ec6f503f tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:18.607844 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-07276772-0b72-4e1f-9701-fbc0ec6f503f tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:18.608322 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-07276772-0b72-4e1f-9701-fbc0ec6f503f tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:18.609102 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-07276772-0b72-4e1f-9701-fbc0ec6f503f tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:18.609542 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-07276772-0b72-4e1f-9701-fbc0ec6f503f tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:18.764091 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-07276772-0b72-4e1f-9701-fbc0ec6f503f tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:18.771394 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-07276772-0b72-4e1f-9701-fbc0ec6f503f tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1505 microversion: 2.1 time: 0.173558 Nov 11 20:40:18.771966 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 154/380] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:18 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:18.785282 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5350620c-3efd-43a0-a426-144239576592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:18.785897 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5350620c-3efd-43a0-a426-144239576592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:18.791552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5350620c-3efd-43a0-a426-144239576592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:18.792027 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5350620c-3efd-43a0-a426-144239576592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:18.792815 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5350620c-3efd-43a0-a426-144239576592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:18.793255 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5350620c-3efd-43a0-a426-144239576592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:18.936980 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5350620c-3efd-43a0-a426-144239576592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:18.946090 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5350620c-3efd-43a0-a426-144239576592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.173054 Nov 11 20:40:18.946987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 155/381] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:18 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:18.952223 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-34a19043-8f5c-4e14-b016-c389f3686a6b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:18.952907 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-34a19043-8f5c-4e14-b016-c389f3686a6b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:18.959292 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-34a19043-8f5c-4e14-b016-c389f3686a6b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:18.959830 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-34a19043-8f5c-4e14-b016-c389f3686a6b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:18.960903 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-34a19043-8f5c-4e14-b016-c389f3686a6b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:18.962034 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-34a19043-8f5c-4e14-b016-c389f3686a6b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:19.050286 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-34a19043-8f5c-4e14-b016-c389f3686a6b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:19.061625 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-34a19043-8f5c-4e14-b016-c389f3686a6b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1270 microversion: 2.1 time: 0.113829 Nov 11 20:40:19.065085 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 156/382] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:18 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1270 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:19.078443 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0d02734d-7b1a-4ba7-b837-82c5da92c1e2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28676 microversion: 2.20 time: 0.553768 Nov 11 20:40:19.079652 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 227/383] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:18 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28676 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:19.134632 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-75ad320f-942a-4df5-bd2b-c1896eec529f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:19.135250 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-75ad320f-942a-4df5-bd2b-c1896eec529f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:19.141746 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-75ad320f-942a-4df5-bd2b-c1896eec529f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:19.142201 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-75ad320f-942a-4df5-bd2b-c1896eec529f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:19.142987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-75ad320f-942a-4df5-bd2b-c1896eec529f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:19.148127 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-75ad320f-942a-4df5-bd2b-c1896eec529f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:19.343728 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f888889a-edad-47b9-bfb3-1b9a56275f89 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:19.344554 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f888889a-edad-47b9-bfb3-1b9a56275f89 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:19.353182 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f888889a-edad-47b9-bfb3-1b9a56275f89 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:19.353764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f888889a-edad-47b9-bfb3-1b9a56275f89 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:19.354559 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f888889a-edad-47b9-bfb3-1b9a56275f89 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:19.355176 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f888889a-edad-47b9-bfb3-1b9a56275f89 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:19.388704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-75ad320f-942a-4df5-bd2b-c1896eec529f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:19.398881 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-75ad320f-942a-4df5-bd2b-c1896eec529f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1363 microversion: 2.1 time: 0.269744 Nov 11 20:40:19.399461 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 157/384] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:19 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:19.569170 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f888889a-edad-47b9-bfb3-1b9a56275f89 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:19.577097 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f888889a-edad-47b9-bfb3-1b9a56275f89 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1314 microversion: 2.1 time: 0.238647 Nov 11 20:40:19.577669 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 228/385] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:19 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:19.614056 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-746bb7a0-de0c-4764-aa71-9a4ce948133f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:19.616003 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-746bb7a0-de0c-4764-aa71-9a4ce948133f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:19.622524 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-746bb7a0-de0c-4764-aa71-9a4ce948133f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:19.622976 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-746bb7a0-de0c-4764-aa71-9a4ce948133f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:19.623770 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-746bb7a0-de0c-4764-aa71-9a4ce948133f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:19.624288 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-746bb7a0-de0c-4764-aa71-9a4ce948133f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:19.790113 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-746bb7a0-de0c-4764-aa71-9a4ce948133f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:19.792520 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-11318cc0-e10b-46eb-8f7e-36eb2cc9ea8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:19.793210 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-11318cc0-e10b-46eb-8f7e-36eb2cc9ea8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:19.800448 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-746bb7a0-de0c-4764-aa71-9a4ce948133f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1548 microversion: 2.1 time: 0.190159 Nov 11 20:40:19.801309 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 158/386] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:19 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1548 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:19.804060 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11318cc0-e10b-46eb-8f7e-36eb2cc9ea8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:19.804926 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11318cc0-e10b-46eb-8f7e-36eb2cc9ea8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:19.805889 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11318cc0-e10b-46eb-8f7e-36eb2cc9ea8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:19.806326 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11318cc0-e10b-46eb-8f7e-36eb2cc9ea8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:19.820454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fbffbe65-9539-42d9-9641-0c2b747575ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:19.821416 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fbffbe65-9539-42d9-9641-0c2b747575ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:19.828890 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fbffbe65-9539-42d9-9641-0c2b747575ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:19.829923 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fbffbe65-9539-42d9-9641-0c2b747575ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:19.830853 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fbffbe65-9539-42d9-9641-0c2b747575ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:19.831454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fbffbe65-9539-42d9-9641-0c2b747575ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.179704 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-11318cc0-e10b-46eb-8f7e-36eb2cc9ea8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:20.188781 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-11318cc0-e10b-46eb-8f7e-36eb2cc9ea8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1505 microversion: 2.1 time: 0.402300 Nov 11 20:40:20.189739 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 229/387] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:19 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:20.203588 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-c1584c72-93b1-40fa-b727-de5e6020fd72 req-1cd81ba5-edfc-4013-ba38-d3c2a8a31937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f94aca5-1944-4a8d-99f9-ad3407734fed", "name": "network-vif-plugged", "status": "completed", "tag": "11f2000a-1143-430a-b241-6ba0551ca4a1"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:20.206031 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-fbffbe65-9539-42d9-9641-0c2b747575ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:20.206267 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:20.206267 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:20.216114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-c1584c72-93b1-40fa-b727-de5e6020fd72 req-1cd81ba5-edfc-4013-ba38-d3c2a8a31937 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.216825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-c1584c72-93b1-40fa-b727-de5e6020fd72 req-1cd81ba5-edfc-4013-ba38-d3c2a8a31937 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.221666 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fbffbe65-9539-42d9-9641-0c2b747575ba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1548 microversion: 2.1 time: 0.406573 Nov 11 20:40:20.235637 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 159/388] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:19 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1548 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:20.236148 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-c1584c72-93b1-40fa-b727-de5e6020fd72 req-1cd81ba5-edfc-4013-ba38-d3c2a8a31937 service nova] Creating event network-vif-plugged:11f2000a-1143-430a-b241-6ba0551ca4a1 for instance 5f94aca5-1944-4a8d-99f9-ad3407734fed on hv-cinder-81764 Nov 11 20:40:20.241970 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-09c38f75-dfac-4fb7-aaae-afe71014ca58 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:20.242838 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-c1584c72-93b1-40fa-b727-de5e6020fd72 req-1cd81ba5-edfc-4013-ba38-d3c2a8a31937 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050958 Nov 11 20:40:20.243725 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-09c38f75-dfac-4fb7-aaae-afe71014ca58 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:20.247442 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 230/389] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:20.252556 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-09c38f75-dfac-4fb7-aaae-afe71014ca58 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.253415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7127b6f1-27b8-421a-a477-57d28430f825 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:20.253861 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-09c38f75-dfac-4fb7-aaae-afe71014ca58 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.254350 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7127b6f1-27b8-421a-a477-57d28430f825 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:20.255230 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-09c38f75-dfac-4fb7-aaae-afe71014ca58 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.255928 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-09c38f75-dfac-4fb7-aaae-afe71014ca58 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.275914 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7127b6f1-27b8-421a-a477-57d28430f825 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.276586 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7127b6f1-27b8-421a-a477-57d28430f825 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.278583 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7127b6f1-27b8-421a-a477-57d28430f825 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.279490 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7127b6f1-27b8-421a-a477-57d28430f825 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.399782 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7127b6f1-27b8-421a-a477-57d28430f825 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:20.407686 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7127b6f1-27b8-421a-a477-57d28430f825 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1276 microversion: 2.1 time: 0.158762 Nov 11 20:40:20.408529 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 231/390] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:20 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:20.414151 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9bb79417-f9cf-4e04-ab5d-18ed4615ddb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:20.415066 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9bb79417-f9cf-4e04-ab5d-18ed4615ddb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:20.420841 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9bb79417-f9cf-4e04-ab5d-18ed4615ddb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.421754 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9bb79417-f9cf-4e04-ab5d-18ed4615ddb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.422701 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9bb79417-f9cf-4e04-ab5d-18ed4615ddb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.423269 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9bb79417-f9cf-4e04-ab5d-18ed4615ddb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.562516 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9bb79417-f9cf-4e04-ab5d-18ed4615ddb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28676 microversion: 2.20 time: 0.152555 Nov 11 20:40:20.567930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 232/391] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:20 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:20.574292 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-47abecd1-2099-49be-9fca-6c14c93ec067 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:20.579865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:20.579865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:20.581461 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-47abecd1-2099-49be-9fca-6c14c93ec067 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:20.582310 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-47abecd1-2099-49be-9fca-6c14c93ec067 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Searching by: {'deleted': False, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208'} {{(pid=122526) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 11 20:40:20.592201 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-47abecd1-2099-49be-9fca-6c14c93ec067 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.592886 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-47abecd1-2099-49be-9fca-6c14c93ec067 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.593700 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-47abecd1-2099-49be-9fca-6c14c93ec067 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.594280 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-47abecd1-2099-49be-9fca-6c14c93ec067 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.610741 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-09c38f75-dfac-4fb7-aaae-afe71014ca58 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:20.642475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-09c38f75-dfac-4fb7-aaae-afe71014ca58 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.402793 Nov 11 20:40:20.646514 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 160/392] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:20 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:20.656444 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fa05c0d5-658c-4324-9c55-92a9128fafb0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:20.658235 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fa05c0d5-658c-4324-9c55-92a9128fafb0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:20.668503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa05c0d5-658c-4324-9c55-92a9128fafb0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.669473 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa05c0d5-658c-4324-9c55-92a9128fafb0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.673160 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa05c0d5-658c-4324-9c55-92a9128fafb0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.674959 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa05c0d5-658c-4324-9c55-92a9128fafb0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.713965 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.multi_cell_list [None req-47abecd1-2099-49be-9fca-6c14c93ec067 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122526) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 11 20:40:20.824988 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-47abecd1-2099-49be-9fca-6c14c93ec067 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.254478 Nov 11 20:40:20.825670 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 233/393] 10.222.0.61 () {58 vars in 1124 bytes} [Thu Nov 11 20:40:20 2021] GET /compute/v2.1/servers => generated 342 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:20.831623 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ae0ddbbf-99a8-4843-8f6c-93ee62264325 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:20.833234 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ae0ddbbf-99a8-4843-8f6c-93ee62264325 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:20.840239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ae0ddbbf-99a8-4843-8f6c-93ee62264325 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.841047 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ae0ddbbf-99a8-4843-8f6c-93ee62264325 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.842051 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ae0ddbbf-99a8-4843-8f6c-93ee62264325 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.842579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ae0ddbbf-99a8-4843-8f6c-93ee62264325 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.934332 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-fa05c0d5-658c-4324-9c55-92a9128fafb0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:20.943477 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fa05c0d5-658c-4324-9c55-92a9128fafb0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1363 microversion: 2.1 time: 0.294410 Nov 11 20:40:20.945235 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 161/394] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:20 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:20.952080 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-862c646e-4298-4027-8e8d-285d4b9435f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:20.953164 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-862c646e-4298-4027-8e8d-285d4b9435f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:20.962871 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-862c646e-4298-4027-8e8d-285d4b9435f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.963692 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-862c646e-4298-4027-8e8d-285d4b9435f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:20.965014 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-862c646e-4298-4027-8e8d-285d4b9435f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:20.965592 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-862c646e-4298-4027-8e8d-285d4b9435f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:21.138961 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ae0ddbbf-99a8-4843-8f6c-93ee62264325 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:21.148743 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ae0ddbbf-99a8-4843-8f6c-93ee62264325 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1314 microversion: 2.1 time: 0.321246 Nov 11 20:40:21.149580 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 234/395] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:20 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:21.207834 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b11322b6-b9e4-4503-83f7-7420ecb85606 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:21.208615 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b11322b6-b9e4-4503-83f7-7420ecb85606 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:21.221768 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b11322b6-b9e4-4503-83f7-7420ecb85606 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:21.222385 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b11322b6-b9e4-4503-83f7-7420ecb85606 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:21.225038 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b11322b6-b9e4-4503-83f7-7420ecb85606 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:21.225598 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b11322b6-b9e4-4503-83f7-7420ecb85606 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:21.297711 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-862c646e-4298-4027-8e8d-285d4b9435f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:21.309889 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-862c646e-4298-4027-8e8d-285d4b9435f5 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1548 microversion: 2.1 time: 0.362555 Nov 11 20:40:21.310812 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 162/396] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:20 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1548 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:21.425699 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fe61e663-ae1e-4007-8e94-52be97a8fdc4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:21.427036 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fe61e663-ae1e-4007-8e94-52be97a8fdc4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:21.437032 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fe61e663-ae1e-4007-8e94-52be97a8fdc4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:21.441053 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fe61e663-ae1e-4007-8e94-52be97a8fdc4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:21.442955 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fe61e663-ae1e-4007-8e94-52be97a8fdc4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:21.446153 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fe61e663-ae1e-4007-8e94-52be97a8fdc4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:21.487760 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b11322b6-b9e4-4503-83f7-7420ecb85606 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:21.497804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b11322b6-b9e4-4503-83f7-7420ecb85606 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1505 microversion: 2.1 time: 0.295676 Nov 11 20:40:21.508797 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 235/397] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:21 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:21.575316 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8717eb8f-6311-437b-9dfc-7c114ad15b27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:21.576642 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8717eb8f-6311-437b-9dfc-7c114ad15b27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:21.583797 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8717eb8f-6311-437b-9dfc-7c114ad15b27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:21.584641 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8717eb8f-6311-437b-9dfc-7c114ad15b27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:21.585703 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8717eb8f-6311-437b-9dfc-7c114ad15b27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:21.586392 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8717eb8f-6311-437b-9dfc-7c114ad15b27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:21.743760 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8717eb8f-6311-437b-9dfc-7c114ad15b27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28676 microversion: 2.20 time: 0.172236 Nov 11 20:40:21.748384 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 236/398] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:21 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:21.754028 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e56491f1-a14d-4771-a155-e61db86c6c30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:21.755447 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e56491f1-a14d-4771-a155-e61db86c6c30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:21.762971 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e56491f1-a14d-4771-a155-e61db86c6c30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:21.763600 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e56491f1-a14d-4771-a155-e61db86c6c30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:21.764645 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e56491f1-a14d-4771-a155-e61db86c6c30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:21.765242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e56491f1-a14d-4771-a155-e61db86c6c30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:21.939099 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-fe61e663-ae1e-4007-8e94-52be97a8fdc4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:21.947840 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fe61e663-ae1e-4007-8e94-52be97a8fdc4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1318 microversion: 2.1 time: 0.526107 Nov 11 20:40:21.948451 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 163/399] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:21 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1318 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:21.963607 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f678dc45-fe81-4532-a7e1-2d8e81c47a26 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:21.964913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f678dc45-fe81-4532-a7e1-2d8e81c47a26 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:21.971184 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f678dc45-fe81-4532-a7e1-2d8e81c47a26 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:21.971706 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f678dc45-fe81-4532-a7e1-2d8e81c47a26 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:21.972590 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f678dc45-fe81-4532-a7e1-2d8e81c47a26 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:21.973126 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f678dc45-fe81-4532-a7e1-2d8e81c47a26 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:22.120334 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e56491f1-a14d-4771-a155-e61db86c6c30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:22.128907 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e56491f1-a14d-4771-a155-e61db86c6c30 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.379121 Nov 11 20:40:22.130324 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 237/400] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:21 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:22.165833 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1e9bbfe3-df74-49ed-a08a-d4df9842bbf5 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:22.166528 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1e9bbfe3-df74-49ed-a08a-d4df9842bbf5 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:22.172457 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1e9bbfe3-df74-49ed-a08a-d4df9842bbf5 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:22.173038 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1e9bbfe3-df74-49ed-a08a-d4df9842bbf5 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:22.173892 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1e9bbfe3-df74-49ed-a08a-d4df9842bbf5 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:22.174390 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1e9bbfe3-df74-49ed-a08a-d4df9842bbf5 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:22.271779 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f678dc45-fe81-4532-a7e1-2d8e81c47a26 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:22.279212 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f678dc45-fe81-4532-a7e1-2d8e81c47a26 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1549 microversion: 2.1 time: 0.319278 Nov 11 20:40:22.279872 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 164/401] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:21 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1549 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:22.296035 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1145168f-be9d-4035-ad9e-7127ba75dd3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:22.296525 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1145168f-be9d-4035-ad9e-7127ba75dd3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:22.303574 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1145168f-be9d-4035-ad9e-7127ba75dd3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:22.304037 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1145168f-be9d-4035-ad9e-7127ba75dd3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:22.304873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1145168f-be9d-4035-ad9e-7127ba75dd3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:22.305557 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1145168f-be9d-4035-ad9e-7127ba75dd3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:22.463767 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1145168f-be9d-4035-ad9e-7127ba75dd3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.170335 Nov 11 20:40:22.463767 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 165/402] 10.222.0.61 () {58 vars in 1274 bytes} [Thu Nov 11 20:40:22 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:40:22.474635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1e9bbfe3-df74-49ed-a08a-d4df9842bbf5 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:22.483083 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1e9bbfe3-df74-49ed-a08a-d4df9842bbf5 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1314 microversion: 2.1 time: 0.320735 Nov 11 20:40:22.483748 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 238/403] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:22 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:22.525828 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c3d28ff6-37d6-4c3e-a9e6-298d8738c83c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:22.526442 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c3d28ff6-37d6-4c3e-a9e6-298d8738c83c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:22.533187 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c3d28ff6-37d6-4c3e-a9e6-298d8738c83c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:22.533639 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c3d28ff6-37d6-4c3e-a9e6-298d8738c83c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:22.534438 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c3d28ff6-37d6-4c3e-a9e6-298d8738c83c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:22.534875 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c3d28ff6-37d6-4c3e-a9e6-298d8738c83c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:22.758077 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-eeadeebd-5c99-4709-8a7a-e1ec8b1d3a47 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:22.760118 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-eeadeebd-5c99-4709-8a7a-e1ec8b1d3a47 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:22.772086 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eeadeebd-5c99-4709-8a7a-e1ec8b1d3a47 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:22.772545 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eeadeebd-5c99-4709-8a7a-e1ec8b1d3a47 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:22.773361 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eeadeebd-5c99-4709-8a7a-e1ec8b1d3a47 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:22.774347 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eeadeebd-5c99-4709-8a7a-e1ec8b1d3a47 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:22.976919 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-eeadeebd-5c99-4709-8a7a-e1ec8b1d3a47 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28676 microversion: 2.20 time: 0.224788 Nov 11 20:40:22.977975 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 239/404] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:22 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:22.983362 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-524042660", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "networks": [{"uuid": "7d0e0821-58b7-4378-8e73-122c99e64b79"}]}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:23.001139 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c3d28ff6-37d6-4c3e-a9e6-298d8738c83c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:23.012864 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c3d28ff6-37d6-4c3e-a9e6-298d8738c83c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1505 microversion: 2.1 time: 0.490719 Nov 11 20:40:23.013462 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 166/405] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:22 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:23.020843 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-708a60f2-549c-45eb-8be8-b0ec47a0d53e req-d6546e89-4c3c-45e5-865f-9cac16d6b815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f872205c-fe9f-4e51-8359-dd7e9e65f155", "tag": "4edbb89c-4f5c-491a-9011-52c3c60a224c"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:23.022666 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:23.022666 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:40:23.031168 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-708a60f2-549c-45eb-8be8-b0ec47a0d53e req-d6546e89-4c3c-45e5-865f-9cac16d6b815 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:23.031614 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-708a60f2-549c-45eb-8be8-b0ec47a0d53e req-d6546e89-4c3c-45e5-865f-9cac16d6b815 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:23.045674 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-708a60f2-549c-45eb-8be8-b0ec47a0d53e req-d6546e89-4c3c-45e5-865f-9cac16d6b815 service nova] Creating event network-changed:4edbb89c-4f5c-491a-9011-52c3c60a224c for instance f872205c-fe9f-4e51-8359-dd7e9e65f155 on hv-cinder-81764 Nov 11 20:40:23.068425 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-708a60f2-549c-45eb-8be8-b0ec47a0d53e req-d6546e89-4c3c-45e5-865f-9cac16d6b815 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036366 Nov 11 20:40:23.068790 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.network.neutron [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] validate_networks() for [('7d0e0821-58b7-4378-8e73-122c99e64b79', None, None, None, None, None)] {{(pid=122526) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:40:23.069649 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 167/406] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:23.075868 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2f3600c1-18a4-410f-affe-ea103c2ab442 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:23.076827 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2f3600c1-18a4-410f-affe-ea103c2ab442 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:23.084291 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f3600c1-18a4-410f-affe-ea103c2ab442 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:23.084983 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f3600c1-18a4-410f-affe-ea103c2ab442 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:23.085951 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f3600c1-18a4-410f-affe-ea103c2ab442 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:23.086399 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f3600c1-18a4-410f-affe-ea103c2ab442 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:23.435339 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-2f3600c1-18a4-410f-affe-ea103c2ab442 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:23.445165 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2f3600c1-18a4-410f-affe-ea103c2ab442 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1318 microversion: 2.1 time: 0.373649 Nov 11 20:40:23.454930 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 168/407] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:23 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:23.454930 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-571207c8-016d-4819-9283-014aaceea214 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f39b2f7-ac04-4358-9568-a21ddc8c5973"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:23.454930 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-571207c8-016d-4819-9283-014aaceea214 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:23.461286 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-571207c8-016d-4819-9283-014aaceea214 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:23.462124 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-571207c8-016d-4819-9283-014aaceea214 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:23.462563 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-571207c8-016d-4819-9283-014aaceea214 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:23.463037 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-571207c8-016d-4819-9283-014aaceea214 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:23.756109 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Flavor limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:40:23.756728 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Image limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:40:23.757208 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Flavor pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:40:23.758011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Image pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:40:23.758330 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:40:23.770075 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:23.771020 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:23.771830 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:23.772288 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:23.787693 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-571207c8-016d-4819-9283-014aaceea214 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "POST /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340249 Nov 11 20:40:23.788775 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 169/408] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:40:23 2021] POST /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:23.793743 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-758424a2-1d11-46c5-8cbd-e5c52c841088 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:23.794657 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-758424a2-1d11-46c5-8cbd-e5c52c841088 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:23.797236 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Getting quotas for project ad9bb6fc32584e87808c292a94dd546d. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:40:23.801015 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-758424a2-1d11-46c5-8cbd-e5c52c841088 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:23.802094 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-758424a2-1d11-46c5-8cbd-e5c52c841088 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:23.802771 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Getting quotas for user 6b39b9079633437aad9181c339fee6b6 and project ad9bb6fc32584e87808c292a94dd546d. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:40:23.803109 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-758424a2-1d11-46c5-8cbd-e5c52c841088 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:23.803718 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-758424a2-1d11-46c5-8cbd-e5c52c841088 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:23.814020 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Going to run 1 instances... {{(pid=122526) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:40:23.817172 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:40:23.891741 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d5a7f265-bb16-411e-b40b-32bdb995b866 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912316 Nov 11 20:40:23.892715 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 240/409] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:40:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:40:23.898772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8ecd0fe4-5146-4fca-aa57-d7bfec3233cb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:23.900036 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8ecd0fe4-5146-4fca-aa57-d7bfec3233cb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:23.907547 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ecd0fe4-5146-4fca-aa57-d7bfec3233cb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:23.908239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ecd0fe4-5146-4fca-aa57-d7bfec3233cb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:23.909042 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ecd0fe4-5146-4fca-aa57-d7bfec3233cb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:23.909925 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ecd0fe4-5146-4fca-aa57-d7bfec3233cb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:24.096527 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-758424a2-1d11-46c5-8cbd-e5c52c841088 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:24.106182 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-758424a2-1d11-46c5-8cbd-e5c52c841088 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.316183 Nov 11 20:40:24.118885 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 170/410] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:23 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:24.125418 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-22f6c43b-7718-43e9-927c-72da26311d98 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:24.132102 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-22f6c43b-7718-43e9-927c-72da26311d98 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:24.277905 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-22f6c43b-7718-43e9-927c-72da26311d98 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:24.288323 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-22f6c43b-7718-43e9-927c-72da26311d98 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1218 microversion: 2.1 time: 0.167124 Nov 11 20:40:24.300411 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 171/411] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:24 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1218 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:24.302221 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8ecd0fe4-5146-4fca-aa57-d7bfec3233cb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:24.306697 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-be79d9c7-0cb4-4681-b41a-d33a1edabeef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:24.307941 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-be79d9c7-0cb4-4681-b41a-d33a1edabeef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:24.312755 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8ecd0fe4-5146-4fca-aa57-d7bfec3233cb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1314 microversion: 2.1 time: 0.417446 Nov 11 20:40:24.313568 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 241/412] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:23 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:24.327503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be79d9c7-0cb4-4681-b41a-d33a1edabeef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:24.327945 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be79d9c7-0cb4-4681-b41a-d33a1edabeef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:24.328758 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be79d9c7-0cb4-4681-b41a-d33a1edabeef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:24.329180 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be79d9c7-0cb4-4681-b41a-d33a1edabeef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:24.331608 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-4d8438f0-7833-4cd9-b753-69c5622f980b req-ecc2065d-9018-4da6-a475-c5b1b02303bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03811f1-6242-47b2-be06-1ed656918ccb", "tag": "53f23a0e-d315-46e7-8373-2a51593bddbf"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:24.334321 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:24.334321 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:24.349977 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-4d8438f0-7833-4cd9-b753-69c5622f980b req-ecc2065d-9018-4da6-a475-c5b1b02303bf service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:24.351092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-4d8438f0-7833-4cd9-b753-69c5622f980b req-ecc2065d-9018-4da6-a475-c5b1b02303bf service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:24.368006 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-4d8438f0-7833-4cd9-b753-69c5622f980b req-ecc2065d-9018-4da6-a475-c5b1b02303bf service nova] Creating event network-changed:53f23a0e-d315-46e7-8373-2a51593bddbf for instance d03811f1-6242-47b2-be06-1ed656918ccb on hv-cinder-81764 Nov 11 20:40:24.374243 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-4d8438f0-7833-4cd9-b753-69c5622f980b req-ecc2065d-9018-4da6-a475-c5b1b02303bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056579 Nov 11 20:40:24.376737 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 242/413] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:24.382027 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-99b2545d-92fe-4872-ba53-a60ea2ecdc94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:24.388012 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-99b2545d-92fe-4872-ba53-a60ea2ecdc94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:24.394375 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-99b2545d-92fe-4872-ba53-a60ea2ecdc94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:24.395060 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-99b2545d-92fe-4872-ba53-a60ea2ecdc94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:24.396713 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-99b2545d-92fe-4872-ba53-a60ea2ecdc94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:24.397101 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-99b2545d-92fe-4872-ba53-a60ea2ecdc94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:24.809253 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-be79d9c7-0cb4-4681-b41a-d33a1edabeef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.507204 Nov 11 20:40:24.812687 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 172/414] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:24 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:24.815422 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-bafa3298-cc95-4509-a976-aecd9907c300 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:24.818551 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-bafa3298-cc95-4509-a976-aecd9907c300 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:24.826633 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bafa3298-cc95-4509-a976-aecd9907c300 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:24.827678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bafa3298-cc95-4509-a976-aecd9907c300 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:24.828718 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bafa3298-cc95-4509-a976-aecd9907c300 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:24.829180 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bafa3298-cc95-4509-a976-aecd9907c300 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:24.887240 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-99b2545d-92fe-4872-ba53-a60ea2ecdc94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28676 microversion: 2.20 time: 0.507947 Nov 11 20:40:24.889944 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 243/415] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:24 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28676 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:24.896874 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0e9fb773-98a8-42e6-8ac1-cb2bd103b68f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:24.898071 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0e9fb773-98a8-42e6-8ac1-cb2bd103b68f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:24.907480 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0e9fb773-98a8-42e6-8ac1-cb2bd103b68f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:24.908329 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0e9fb773-98a8-42e6-8ac1-cb2bd103b68f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:24.909548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0e9fb773-98a8-42e6-8ac1-cb2bd103b68f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:24.910148 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0e9fb773-98a8-42e6-8ac1-cb2bd103b68f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:25.264977 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0e9fb773-98a8-42e6-8ac1-cb2bd103b68f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:25.273480 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0e9fb773-98a8-42e6-8ac1-cb2bd103b68f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1318 microversion: 2.1 time: 0.381882 Nov 11 20:40:25.274509 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 244/416] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:24 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:25.278818 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-89ccfbd0-cedb-490c-aff0-34aeb04fa74b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:25.279697 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-89ccfbd0-cedb-490c-aff0-34aeb04fa74b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:25.287706 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-89ccfbd0-cedb-490c-aff0-34aeb04fa74b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:25.288305 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-89ccfbd0-cedb-490c-aff0-34aeb04fa74b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:25.289113 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-89ccfbd0-cedb-490c-aff0-34aeb04fa74b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:25.289555 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-89ccfbd0-cedb-490c-aff0-34aeb04fa74b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:25.317753 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-bafa3298-cc95-4509-a976-aecd9907c300 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:25.334148 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-bafa3298-cc95-4509-a976-aecd9907c300 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1505 microversion: 2.1 time: 0.522557 Nov 11 20:40:25.334746 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 173/417] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:24 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:25.343756 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4bfef83c-c4d7-4cf0-8489-cf57bed12eb8 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:25.344659 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4bfef83c-c4d7-4cf0-8489-cf57bed12eb8 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:25.351024 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4bfef83c-c4d7-4cf0-8489-cf57bed12eb8 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:25.351472 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4bfef83c-c4d7-4cf0-8489-cf57bed12eb8 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:25.352396 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4bfef83c-c4d7-4cf0-8489-cf57bed12eb8 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:25.352833 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4bfef83c-c4d7-4cf0-8489-cf57bed12eb8 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:25.465719 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-4bfef83c-c4d7-4cf0-8489-cf57bed12eb8 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:25.476447 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4bfef83c-c4d7-4cf0-8489-cf57bed12eb8 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1270 microversion: 2.1 time: 0.135847 Nov 11 20:40:25.477616 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 174/418] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:25 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1270 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:25.487354 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ccecb408-f2db-4cd3-a367-d77f06c413f9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:25.487354 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ccecb408-f2db-4cd3-a367-d77f06c413f9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:25.490175 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ccecb408-f2db-4cd3-a367-d77f06c413f9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:25.490628 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ccecb408-f2db-4cd3-a367-d77f06c413f9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:25.491429 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ccecb408-f2db-4cd3-a367-d77f06c413f9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:25.491865 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ccecb408-f2db-4cd3-a367-d77f06c413f9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:25.683763 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-89ccfbd0-cedb-490c-aff0-34aeb04fa74b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:25.692392 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-89ccfbd0-cedb-490c-aff0-34aeb04fa74b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1522 microversion: 2.1 time: 0.416529 Nov 11 20:40:25.693032 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 245/419] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:25 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:25.821902 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b87a0672-ce40-4966-8a66-b576d7f44d2a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:25.822892 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b87a0672-ce40-4966-8a66-b576d7f44d2a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:25.824999 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ccecb408-f2db-4cd3-a367-d77f06c413f9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:25.830139 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b87a0672-ce40-4966-8a66-b576d7f44d2a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:25.830591 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b87a0672-ce40-4966-8a66-b576d7f44d2a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:25.831388 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b87a0672-ce40-4966-8a66-b576d7f44d2a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:25.832118 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b87a0672-ce40-4966-8a66-b576d7f44d2a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:25.834091 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ccecb408-f2db-4cd3-a367-d77f06c413f9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1463 microversion: 2.1 time: 0.355207 Nov 11 20:40:25.834941 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 175/420] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:25 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1463 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:25.874550 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5c0296a8-96ac-4cb9-9c76-ad80cf15b234 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:25.875049 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5c0296a8-96ac-4cb9-9c76-ad80cf15b234 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:25.883236 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5c0296a8-96ac-4cb9-9c76-ad80cf15b234 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:25.883600 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5c0296a8-96ac-4cb9-9c76-ad80cf15b234 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:25.884410 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5c0296a8-96ac-4cb9-9c76-ad80cf15b234 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:25.884978 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5c0296a8-96ac-4cb9-9c76-ad80cf15b234 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:25.909711 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5c0296a8-96ac-4cb9-9c76-ad80cf15b234 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Going to try to terminate instance {{(pid=122527) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:40:25.970998 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b87a0672-ce40-4966-8a66-b576d7f44d2a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.152421 Nov 11 20:40:25.973264 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 246/421] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:25 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:25.981677 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6c3e4068-adb2-4b74-a14e-912e8deb4446 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:25.983500 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6c3e4068-adb2-4b74-a14e-912e8deb4446 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:25.995546 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6c3e4068-adb2-4b74-a14e-912e8deb4446 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:25.996006 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6c3e4068-adb2-4b74-a14e-912e8deb4446 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:25.996796 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6c3e4068-adb2-4b74-a14e-912e8deb4446 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:25.997224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6c3e4068-adb2-4b74-a14e-912e8deb4446 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.025652 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5c0296a8-96ac-4cb9-9c76-ad80cf15b234 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 204 len: 0 microversion: 2.1 time: 0.154716 Nov 11 20:40:26.026245 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 176/422] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:40:25 2021] DELETE /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 11 20:40:26.043016 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-dee5f353-ae86-4406-9fbc-3fdada75b70b tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:26.043662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-dee5f353-ae86-4406-9fbc-3fdada75b70b tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:26.049798 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dee5f353-ae86-4406-9fbc-3fdada75b70b tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:26.050367 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dee5f353-ae86-4406-9fbc-3fdada75b70b tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.052641 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dee5f353-ae86-4406-9fbc-3fdada75b70b tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:26.053655 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dee5f353-ae86-4406-9fbc-3fdada75b70b tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.192169 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6c3e4068-adb2-4b74-a14e-912e8deb4446 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 28676 microversion: 2.20 time: 0.216604 Nov 11 20:40:26.193070 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 247/423] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:25 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 28676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:26.295118 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ccd58f67-3fb7-44fc-ba30-bea2441a7b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:26.297065 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ccd58f67-3fb7-44fc-ba30-bea2441a7b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:26.307518 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ccd58f67-3fb7-44fc-ba30-bea2441a7b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:26.308775 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ccd58f67-3fb7-44fc-ba30-bea2441a7b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.310122 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ccd58f67-3fb7-44fc-ba30-bea2441a7b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:26.310816 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ccd58f67-3fb7-44fc-ba30-bea2441a7b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.316224 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-dee5f353-ae86-4406-9fbc-3fdada75b70b tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:26.324286 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-dee5f353-ae86-4406-9fbc-3fdada75b70b tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1469 microversion: 2.1 time: 0.292805 Nov 11 20:40:26.325161 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 177/424] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:26 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1469 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:26.330037 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-b0f1158b-feff-482b-a417-9ee8a46322ce req-15b6aefc-1afe-4390-bb85-d87b4fb8c039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b5e5fb-4793-4495-a93b-321835ecf1b3", "name": "network-vif-deleted", "tag": "b01233b4-ce9c-4445-81a3-554fbf132f2f"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:26.331915 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:26.331915 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:40:26.342630 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-b0f1158b-feff-482b-a417-9ee8a46322ce req-15b6aefc-1afe-4390-bb85-d87b4fb8c039 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:26.343333 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-b0f1158b-feff-482b-a417-9ee8a46322ce req-15b6aefc-1afe-4390-bb85-d87b4fb8c039 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.356440 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-b0f1158b-feff-482b-a417-9ee8a46322ce req-15b6aefc-1afe-4390-bb85-d87b4fb8c039 service nova] Creating event network-vif-deleted:b01233b4-ce9c-4445-81a3-554fbf132f2f for instance 09b5e5fb-4793-4495-a93b-321835ecf1b3 on hv-cinder-81764 Nov 11 20:40:26.361873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-b0f1158b-feff-482b-a417-9ee8a46322ce req-15b6aefc-1afe-4390-bb85-d87b4fb8c039 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035541 Nov 11 20:40:26.362599 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 178/425] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:26.367646 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c9c04aa9-9876-454f-9714-494dfa298e4e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:26.368387 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c9c04aa9-9876-454f-9714-494dfa298e4e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:26.374468 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c9c04aa9-9876-454f-9714-494dfa298e4e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:26.374920 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c9c04aa9-9876-454f-9714-494dfa298e4e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.375713 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c9c04aa9-9876-454f-9714-494dfa298e4e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:26.376175 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c9c04aa9-9876-454f-9714-494dfa298e4e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.725738 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c9c04aa9-9876-454f-9714-494dfa298e4e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:26.733178 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c9c04aa9-9876-454f-9714-494dfa298e4e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 200 len: 1463 microversion: 2.1 time: 0.369453 Nov 11 20:40:26.733753 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 179/426] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:26 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 1463 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:26.738232 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-417826b4-b546-450a-9db0-e5c5bbe3bc6e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:26.739871 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-417826b4-b546-450a-9db0-e5c5bbe3bc6e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:26.745207 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-417826b4-b546-450a-9db0-e5c5bbe3bc6e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:26.745660 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-417826b4-b546-450a-9db0-e5c5bbe3bc6e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.746448 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-417826b4-b546-450a-9db0-e5c5bbe3bc6e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:26.746879 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-417826b4-b546-450a-9db0-e5c5bbe3bc6e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.831159 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-417826b4-b546-450a-9db0-e5c5bbe3bc6e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:26.839044 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-417826b4-b546-450a-9db0-e5c5bbe3bc6e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1276 microversion: 2.1 time: 0.104248 Nov 11 20:40:26.839617 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 180/427] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:26 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1276 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:26.843845 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-407e16fb-25e0-404c-8514-82bbd9799230 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:26.844462 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-407e16fb-25e0-404c-8514-82bbd9799230 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:26.850683 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-407e16fb-25e0-404c-8514-82bbd9799230 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:26.851040 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-407e16fb-25e0-404c-8514-82bbd9799230 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.851857 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-407e16fb-25e0-404c-8514-82bbd9799230 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:26.852326 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-407e16fb-25e0-404c-8514-82bbd9799230 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.883179 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ccd58f67-3fb7-44fc-ba30-bea2441a7b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:26.890802 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ccd58f67-3fb7-44fc-ba30-bea2441a7b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1318 microversion: 2.1 time: 0.602697 Nov 11 20:40:26.891379 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 248/428] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:26 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:26.984025 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b1673715-98a4-4875-9c6c-2489a4900757 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:26.984942 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b1673715-98a4-4875-9c6c-2489a4900757 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:26.997983 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b1673715-98a4-4875-9c6c-2489a4900757 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:26.998658 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b1673715-98a4-4875-9c6c-2489a4900757 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:26.999488 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b1673715-98a4-4875-9c6c-2489a4900757 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:27.000119 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b1673715-98a4-4875-9c6c-2489a4900757 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:27.081973 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-407e16fb-25e0-404c-8514-82bbd9799230 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:27.090735 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-407e16fb-25e0-404c-8514-82bbd9799230 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1502 microversion: 2.1 time: 0.249877 Nov 11 20:40:27.101942 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 181/429] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:26 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:27.109019 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4822638d-4a4d-46da-b937-088e995b4f3f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:27.110307 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4822638d-4a4d-46da-b937-088e995b4f3f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:27.119786 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4822638d-4a4d-46da-b937-088e995b4f3f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:27.120539 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4822638d-4a4d-46da-b937-088e995b4f3f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:27.121345 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4822638d-4a4d-46da-b937-088e995b4f3f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:27.121932 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4822638d-4a4d-46da-b937-088e995b4f3f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:27.149123 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b1673715-98a4-4875-9c6c-2489a4900757 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.168463 Nov 11 20:40:27.150405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 249/430] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:26 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:40:27.205406 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0d6b9a2a-67c1-4d10-bc23-d5546eb0fb7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:27.206674 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0d6b9a2a-67c1-4d10-bc23-d5546eb0fb7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:27.214304 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d6b9a2a-67c1-4d10-bc23-d5546eb0fb7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:27.214761 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d6b9a2a-67c1-4d10-bc23-d5546eb0fb7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:27.215560 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d6b9a2a-67c1-4d10-bc23-d5546eb0fb7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:27.216171 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d6b9a2a-67c1-4d10-bc23-d5546eb0fb7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:27.339515 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-4822638d-4a4d-46da-b937-088e995b4f3f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:27.346863 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4822638d-4a4d-46da-b937-088e995b4f3f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1516 microversion: 2.1 time: 0.242530 Nov 11 20:40:27.347456 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 182/431] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:27 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1516 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:27.355162 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-621db968-df5e-41eb-9bd5-fc06d9cb9d2a tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:27.356017 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-621db968-df5e-41eb-9bd5-fc06d9cb9d2a tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:27.362624 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-621db968-df5e-41eb-9bd5-fc06d9cb9d2a tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:27.363079 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-621db968-df5e-41eb-9bd5-fc06d9cb9d2a tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:27.364546 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-621db968-df5e-41eb-9bd5-fc06d9cb9d2a tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:27.364984 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-621db968-df5e-41eb-9bd5-fc06d9cb9d2a tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:27.430580 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0d6b9a2a-67c1-4d10-bc23-d5546eb0fb7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 29092 microversion: 2.20 time: 0.228614 Nov 11 20:40:27.432214 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 250/432] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:27 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 29092 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:40:27.596731 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-621db968-df5e-41eb-9bd5-fc06d9cb9d2a tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:27.605934 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-621db968-df5e-41eb-9bd5-fc06d9cb9d2a tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1469 microversion: 2.1 time: 0.256644 Nov 11 20:40:27.616554 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 183/433] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:27 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:27.750650 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0cb9d925-f584-440c-8b4c-f96a8ae6864e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:27.751348 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0cb9d925-f584-440c-8b4c-f96a8ae6864e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 09b5e5fb-4793-4495-a93b-321835ecf1b3] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:27.761508 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0cb9d925-f584-440c-8b4c-f96a8ae6864e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:27.761957 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0cb9d925-f584-440c-8b4c-f96a8ae6864e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:27.762791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0cb9d925-f584-440c-8b4c-f96a8ae6864e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:27.763375 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0cb9d925-f584-440c-8b4c-f96a8ae6864e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:27.779574 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-0cb9d925-f584-440c-8b4c-f96a8ae6864e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] HTTP exception thrown: Instance 09b5e5fb-4793-4495-a93b-321835ecf1b3 could not be found. Nov 11 20:40:27.780195 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0cb9d925-f584-440c-8b4c-f96a8ae6864e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Returning 404 to user: Instance 09b5e5fb-4793-4495-a93b-321835ecf1b3 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:40:27.781035 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0cb9d925-f584-440c-8b4c-f96a8ae6864e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3" status: 404 len: 111 microversion: 2.1 time: 0.034444 Nov 11 20:40:27.781592 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 251/434] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:27 2021] GET /compute/v2.1/servers/09b5e5fb-4793-4495-a93b-321835ecf1b3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:40:27.856781 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-02e6a6d6-16cb-4149-b15a-f8d6dd44bf44 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:27.857412 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-02e6a6d6-16cb-4149-b15a-f8d6dd44bf44 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:27.865449 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-02e6a6d6-16cb-4149-b15a-f8d6dd44bf44 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:27.865904 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-02e6a6d6-16cb-4149-b15a-f8d6dd44bf44 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:27.866682 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-02e6a6d6-16cb-4149-b15a-f8d6dd44bf44 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:27.867315 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-02e6a6d6-16cb-4149-b15a-f8d6dd44bf44 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:27.886003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1600631733", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "networks": [{"uuid": "ce672723-6882-4ab4-9659-ebe86d0ace99"}]}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:27.947423 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.network.neutron [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] validate_networks() for [('ce672723-6882-4ab4-9659-ebe86d0ace99', None, None, None, None, None)] {{(pid=122526) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:40:28.229880 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-02e6a6d6-16cb-4149-b15a-f8d6dd44bf44 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:28.246384 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-02e6a6d6-16cb-4149-b15a-f8d6dd44bf44 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1318 microversion: 2.1 time: 0.393431 Nov 11 20:40:28.256273 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 184/435] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:27 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:28.256273 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-40726636-827b-4482-a4b8-236128732b83 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:28.256273 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-40726636-827b-4482-a4b8-236128732b83 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:28.259528 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-40726636-827b-4482-a4b8-236128732b83 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:28.260023 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-40726636-827b-4482-a4b8-236128732b83 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:28.260813 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-40726636-827b-4482-a4b8-236128732b83 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:28.261268 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-40726636-827b-4482-a4b8-236128732b83 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:28.655558 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-40726636-827b-4482-a4b8-236128732b83 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:28.663678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-40726636-827b-4482-a4b8-236128732b83 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1318 microversion: 2.1 time: 0.414752 Nov 11 20:40:28.664284 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 185/436] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:28 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:28.679336 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9f4bb2f8-8208-4f4f-b3dc-884b5381146d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:28.680429 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9f4bb2f8-8208-4f4f-b3dc-884b5381146d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:28.686783 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9f4bb2f8-8208-4f4f-b3dc-884b5381146d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:28.687234 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9f4bb2f8-8208-4f4f-b3dc-884b5381146d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:28.688110 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9f4bb2f8-8208-4f4f-b3dc-884b5381146d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:28.688543 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9f4bb2f8-8208-4f4f-b3dc-884b5381146d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:28.701135 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Flavor limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:40:28.702039 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Image limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:40:28.702604 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Flavor pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:40:28.703060 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Image pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:40:28.703554 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:40:28.713457 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:28.714452 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:28.715518 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:28.716579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:28.736000 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Getting quotas for project da3138643605461997fb39e99bac9845. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:40:28.743000 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Getting quotas for user 67e9b275844d430db3a1826bb4306612 and project da3138643605461997fb39e99bac9845. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:40:28.757782 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Going to run 1 instances... {{(pid=122526) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:40:28.760410 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:40:28.815635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-80b875d1-55a6-4ae3-b34d-05ad6c5abf8e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.933537 Nov 11 20:40:28.822291 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 252/437] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:40:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 11 20:40:28.823305 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2c2196a8-6c58-4052-87f3-3ee6daa76c4c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:28.825304 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2c2196a8-6c58-4052-87f3-3ee6daa76c4c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:28.833327 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2c2196a8-6c58-4052-87f3-3ee6daa76c4c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:28.836839 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2c2196a8-6c58-4052-87f3-3ee6daa76c4c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:28.836839 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2c2196a8-6c58-4052-87f3-3ee6daa76c4c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:28.836839 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2c2196a8-6c58-4052-87f3-3ee6daa76c4c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:28.872469 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9f4bb2f8-8208-4f4f-b3dc-884b5381146d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.206444 Nov 11 20:40:28.873429 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 186/438] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:28 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:28.879920 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5858cb7a-b99a-4bdb-a07f-e24e9836b210 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:28.880780 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5858cb7a-b99a-4bdb-a07f-e24e9836b210 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:28.889265 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5858cb7a-b99a-4bdb-a07f-e24e9836b210 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:28.889734 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5858cb7a-b99a-4bdb-a07f-e24e9836b210 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:28.890801 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5858cb7a-b99a-4bdb-a07f-e24e9836b210 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:28.891252 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5858cb7a-b99a-4bdb-a07f-e24e9836b210 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:29.038635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2c2196a8-6c58-4052-87f3-3ee6daa76c4c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 30078 microversion: 2.20 time: 0.219588 Nov 11 20:40:29.039298 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 253/439] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:28 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 30078 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:29.052255 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e79f979f-1e90-4704-a8c2-f7be6705d7e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:29.056194 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e79f979f-1e90-4704-a8c2-f7be6705d7e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:29.063883 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e79f979f-1e90-4704-a8c2-f7be6705d7e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:29.064496 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e79f979f-1e90-4704-a8c2-f7be6705d7e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:29.065291 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e79f979f-1e90-4704-a8c2-f7be6705d7e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:29.065719 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e79f979f-1e90-4704-a8c2-f7be6705d7e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:29.102821 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-e79f979f-1e90-4704-a8c2-f7be6705d7e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lazy-loading 'flavor' on Instance uuid ddd75246-98f4-4479-be99-f39c6427cc92 {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:40:29.118383 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5858cb7a-b99a-4bdb-a07f-e24e9836b210 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:29.128596 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5858cb7a-b99a-4bdb-a07f-e24e9836b210 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1469 microversion: 2.1 time: 0.253666 Nov 11 20:40:29.142940 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 187/440] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:28 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1469 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:29.148273 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8b9575d9-aaaa-482d-83fc-f7845d6b4038 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:29.149058 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8b9575d9-aaaa-482d-83fc-f7845d6b4038 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:29.252689 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-8b9575d9-aaaa-482d-83fc-f7845d6b4038 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:29.255135 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e79f979f-1e90-4704-a8c2-f7be6705d7e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "POST /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/action" status: 200 len: 32 microversion: 2.1 time: 0.211701 Nov 11 20:40:29.256739 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 254/441] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:29 2021] POST /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/action => generated 32 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:29.265117 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-a026102c-79da-4145-8bc0-90bf402a02cd req-6c5cac93-7015-459b-bbf7-863eeabe14ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a68a80-f2c4-48c3-ac43-f1e76012f3ea", "tag": "55137242-2e6b-4a3a-a796-20d6c605c358"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:29.266882 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:29.266882 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:29.268003 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8b9575d9-aaaa-482d-83fc-f7845d6b4038 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1214 microversion: 2.1 time: 0.123755 Nov 11 20:40:29.268565 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 188/442] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:29 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:29.276701 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-55a33cfe-df77-4ad4-b2ba-5dcb18630282 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:29.277594 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-55a33cfe-df77-4ad4-b2ba-5dcb18630282 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:29.288201 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-55a33cfe-df77-4ad4-b2ba-5dcb18630282 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:29.289156 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-55a33cfe-df77-4ad4-b2ba-5dcb18630282 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:29.290676 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-55a33cfe-df77-4ad4-b2ba-5dcb18630282 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:29.291476 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-55a33cfe-df77-4ad4-b2ba-5dcb18630282 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:29.293214 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-a026102c-79da-4145-8bc0-90bf402a02cd req-6c5cac93-7015-459b-bbf7-863eeabe14ca service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:29.294422 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-a026102c-79da-4145-8bc0-90bf402a02cd req-6c5cac93-7015-459b-bbf7-863eeabe14ca service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:29.317770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-a026102c-79da-4145-8bc0-90bf402a02cd req-6c5cac93-7015-459b-bbf7-863eeabe14ca service nova] Creating event network-changed:55137242-2e6b-4a3a-a796-20d6c605c358 for instance 88a68a80-f2c4-48c3-ac43-f1e76012f3ea on hv-cinder-81764 Nov 11 20:40:29.322781 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-a026102c-79da-4145-8bc0-90bf402a02cd req-6c5cac93-7015-459b-bbf7-863eeabe14ca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064135 Nov 11 20:40:29.323372 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 255/443] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:29.330416 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-79d9a3b6-5597-4576-9f52-21d42e3da212 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:29.331307 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-79d9a3b6-5597-4576-9f52-21d42e3da212 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:29.338191 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-79d9a3b6-5597-4576-9f52-21d42e3da212 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:29.339316 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-79d9a3b6-5597-4576-9f52-21d42e3da212 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:29.340151 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-79d9a3b6-5597-4576-9f52-21d42e3da212 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:29.341016 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-79d9a3b6-5597-4576-9f52-21d42e3da212 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:29.699964 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-55a33cfe-df77-4ad4-b2ba-5dcb18630282 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:29.708385 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-55a33cfe-df77-4ad4-b2ba-5dcb18630282 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1318 microversion: 2.1 time: 0.438015 Nov 11 20:40:29.708970 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 189/444] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:29 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:29.713417 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-475b3016-ad4d-4b98-a5bd-519401ab7768 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:29.714014 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-475b3016-ad4d-4b98-a5bd-519401ab7768 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:29.720245 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-475b3016-ad4d-4b98-a5bd-519401ab7768 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:29.720708 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-475b3016-ad4d-4b98-a5bd-519401ab7768 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:29.725033 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-475b3016-ad4d-4b98-a5bd-519401ab7768 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:29.725033 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-475b3016-ad4d-4b98-a5bd-519401ab7768 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:29.753398 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-79d9a3b6-5597-4576-9f52-21d42e3da212 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:29.761389 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-79d9a3b6-5597-4576-9f52-21d42e3da212 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.436118 Nov 11 20:40:29.761966 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 256/445] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:29 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:29.883358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-240c4682-6f99-49ce-9a0a-7c4544c5ff56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:29.884417 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-240c4682-6f99-49ce-9a0a-7c4544c5ff56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:29.890629 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-240c4682-6f99-49ce-9a0a-7c4544c5ff56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:29.891072 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-240c4682-6f99-49ce-9a0a-7c4544c5ff56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:29.891855 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-240c4682-6f99-49ce-9a0a-7c4544c5ff56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:29.892304 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-240c4682-6f99-49ce-9a0a-7c4544c5ff56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:30.058063 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-240c4682-6f99-49ce-9a0a-7c4544c5ff56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.178813 Nov 11 20:40:30.061274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 257/446] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:29 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:40:30.064074 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7c35e02b-25ca-420a-9c74-34df1d0c0994 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:30.065118 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7c35e02b-25ca-420a-9c74-34df1d0c0994 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:30.073507 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7c35e02b-25ca-420a-9c74-34df1d0c0994 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:30.073952 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7c35e02b-25ca-420a-9c74-34df1d0c0994 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:30.074739 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7c35e02b-25ca-420a-9c74-34df1d0c0994 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:30.075167 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7c35e02b-25ca-420a-9c74-34df1d0c0994 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:30.209171 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-475b3016-ad4d-4b98-a5bd-519401ab7768 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:30.216485 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-475b3016-ad4d-4b98-a5bd-519401ab7768 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1318 microversion: 2.1 time: 0.506546 Nov 11 20:40:30.217049 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 190/447] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:29 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:30.221591 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-256fa813-dcc7-4575-a8f9-7795833c0ebb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:30.222014 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-256fa813-dcc7-4575-a8f9-7795833c0ebb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:30.227520 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7c35e02b-25ca-420a-9c74-34df1d0c0994 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 30749 microversion: 2.20 time: 0.167230 Nov 11 20:40:30.229316 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 258/448] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:30 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 30749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:30.231961 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-256fa813-dcc7-4575-a8f9-7795833c0ebb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:30.232432 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-256fa813-dcc7-4575-a8f9-7795833c0ebb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:30.233211 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-256fa813-dcc7-4575-a8f9-7795833c0ebb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:30.233644 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-256fa813-dcc7-4575-a8f9-7795833c0ebb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:30.290237 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b52aba8a-8862-40b5-8283-aa4249ab0bf5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:30.291190 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b52aba8a-8862-40b5-8283-aa4249ab0bf5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:30.299007 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b52aba8a-8862-40b5-8283-aa4249ab0bf5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:30.299453 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b52aba8a-8862-40b5-8283-aa4249ab0bf5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:30.300290 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b52aba8a-8862-40b5-8283-aa4249ab0bf5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:30.300721 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b52aba8a-8862-40b5-8283-aa4249ab0bf5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:30.388682 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b52aba8a-8862-40b5-8283-aa4249ab0bf5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:30.396287 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b52aba8a-8862-40b5-8283-aa4249ab0bf5 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1266 microversion: 2.1 time: 0.111949 Nov 11 20:40:30.396868 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 259/449] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:30 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:30.497440 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-256fa813-dcc7-4575-a8f9-7795833c0ebb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:30.504620 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-256fa813-dcc7-4575-a8f9-7795833c0ebb tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1469 microversion: 2.1 time: 0.286621 Nov 11 20:40:30.505353 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 191/450] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:30 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1469 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:30.726605 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-622ffd10-b382-4365-a434-49923d4e38cf tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:30.727230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-622ffd10-b382-4365-a434-49923d4e38cf tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:30.733533 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-622ffd10-b382-4365-a434-49923d4e38cf tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:30.733980 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-622ffd10-b382-4365-a434-49923d4e38cf tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:30.734764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-622ffd10-b382-4365-a434-49923d4e38cf tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:30.735188 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-622ffd10-b382-4365-a434-49923d4e38cf tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:30.779137 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-58072f10-6b4a-4f9d-ae2f-27a9bb6dafc7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:30.779739 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-58072f10-6b4a-4f9d-ae2f-27a9bb6dafc7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:30.786287 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-58072f10-6b4a-4f9d-ae2f-27a9bb6dafc7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:30.786984 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-58072f10-6b4a-4f9d-ae2f-27a9bb6dafc7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:30.787780 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-58072f10-6b4a-4f9d-ae2f-27a9bb6dafc7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:30.788240 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-58072f10-6b4a-4f9d-ae2f-27a9bb6dafc7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:31.138682 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-622ffd10-b382-4365-a434-49923d4e38cf tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:31.147913 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-622ffd10-b382-4365-a434-49923d4e38cf tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1318 microversion: 2.1 time: 0.425632 Nov 11 20:40:31.150220 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 260/451] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:30 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:31.162248 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-59f044d7-e95f-4b9e-bd87-f95c578c57b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:31.166351 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-59f044d7-e95f-4b9e-bd87-f95c578c57b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:31.173185 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-59f044d7-e95f-4b9e-bd87-f95c578c57b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:31.174161 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-59f044d7-e95f-4b9e-bd87-f95c578c57b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:31.175092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-59f044d7-e95f-4b9e-bd87-f95c578c57b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:31.175689 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-59f044d7-e95f-4b9e-bd87-f95c578c57b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:31.265095 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-58072f10-6b4a-4f9d-ae2f-27a9bb6dafc7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:31.273816 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-58072f10-6b4a-4f9d-ae2f-27a9bb6dafc7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.498241 Nov 11 20:40:31.274626 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 192/452] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:30 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:31.279275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-32c990b2-8863-4733-ab6d-c7efcb3ac03c req-3f26dffb-55ce-42b5-9a50-b301ed03f1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f872205c-fe9f-4e51-8359-dd7e9e65f155", "name": "network-vif-plugged", "status": "completed", "tag": "4edbb89c-4f5c-491a-9011-52c3c60a224c"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:31.280985 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:31.280985 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:40:31.289532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-32c990b2-8863-4733-ab6d-c7efcb3ac03c req-3f26dffb-55ce-42b5-9a50-b301ed03f1ab service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:31.289970 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-32c990b2-8863-4733-ab6d-c7efcb3ac03c req-3f26dffb-55ce-42b5-9a50-b301ed03f1ab service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:31.318985 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-32c990b2-8863-4733-ab6d-c7efcb3ac03c req-3f26dffb-55ce-42b5-9a50-b301ed03f1ab service nova] Creating event network-vif-plugged:4edbb89c-4f5c-491a-9011-52c3c60a224c for instance f872205c-fe9f-4e51-8359-dd7e9e65f155 on hv-cinder-81764 Nov 11 20:40:31.331726 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-32c990b2-8863-4733-ab6d-c7efcb3ac03c req-3f26dffb-55ce-42b5-9a50-b301ed03f1ab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055922 Nov 11 20:40:31.333975 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 193/453] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:31.339667 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6f3ead50-bc10-4187-9c2d-898bee614508 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:31.340654 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6f3ead50-bc10-4187-9c2d-898bee614508 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:31.348743 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f3ead50-bc10-4187-9c2d-898bee614508 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:31.349187 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f3ead50-bc10-4187-9c2d-898bee614508 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:31.349972 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f3ead50-bc10-4187-9c2d-898bee614508 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:31.350402 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f3ead50-bc10-4187-9c2d-898bee614508 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:31.437753 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-59f044d7-e95f-4b9e-bd87-f95c578c57b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.285452 Nov 11 20:40:31.441387 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 261/454] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:31 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:31.443655 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4c4acef5-85ca-4f19-a452-8037b296a001 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:31.444751 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4c4acef5-85ca-4f19-a452-8037b296a001 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:31.452059 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4c4acef5-85ca-4f19-a452-8037b296a001 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:31.452598 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4c4acef5-85ca-4f19-a452-8037b296a001 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:31.453490 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4c4acef5-85ca-4f19-a452-8037b296a001 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:31.453997 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4c4acef5-85ca-4f19-a452-8037b296a001 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:31.719954 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-6f3ead50-bc10-4187-9c2d-898bee614508 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:31.728220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6f3ead50-bc10-4187-9c2d-898bee614508 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1318 microversion: 2.1 time: 0.393533 Nov 11 20:40:31.728829 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 194/455] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:31 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:31.733074 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7da58314-5c60-40c5-9714-3f7da35e939e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:31.733670 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7da58314-5c60-40c5-9714-3f7da35e939e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:31.740926 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7da58314-5c60-40c5-9714-3f7da35e939e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:31.741799 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7da58314-5c60-40c5-9714-3f7da35e939e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:31.743195 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7da58314-5c60-40c5-9714-3f7da35e939e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:31.743650 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7da58314-5c60-40c5-9714-3f7da35e939e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:31.776864 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4c4acef5-85ca-4f19-a452-8037b296a001 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 31706 microversion: 2.20 time: 0.336910 Nov 11 20:40:31.778244 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 262/456] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:31 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 31706 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:31.784035 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6dd6bbc7-11ca-493c-8b2e-78f1fe075da9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:31.784994 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6dd6bbc7-11ca-493c-8b2e-78f1fe075da9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:31.793567 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6dd6bbc7-11ca-493c-8b2e-78f1fe075da9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:31.794017 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6dd6bbc7-11ca-493c-8b2e-78f1fe075da9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:31.795066 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6dd6bbc7-11ca-493c-8b2e-78f1fe075da9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:31.795500 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6dd6bbc7-11ca-493c-8b2e-78f1fe075da9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:31.993647 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7da58314-5c60-40c5-9714-3f7da35e939e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:32.003465 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7da58314-5c60-40c5-9714-3f7da35e939e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1272 microversion: 2.1 time: 0.273607 Nov 11 20:40:32.004918 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 195/457] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:31 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1272 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:32.165763 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-016014ce-2052-4105-8ea9-a13473090d78 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:32.166526 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-016014ce-2052-4105-8ea9-a13473090d78 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:32.173433 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-016014ce-2052-4105-8ea9-a13473090d78 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:32.174050 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-016014ce-2052-4105-8ea9-a13473090d78 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:32.174942 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-016014ce-2052-4105-8ea9-a13473090d78 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:32.175619 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-016014ce-2052-4105-8ea9-a13473090d78 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:32.206192 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6dd6bbc7-11ca-493c-8b2e-78f1fe075da9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:32.214012 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6dd6bbc7-11ca-493c-8b2e-78f1fe075da9 tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1469 microversion: 2.1 time: 0.434136 Nov 11 20:40:32.214584 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 263/458] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:31 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1469 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:32.290533 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-167a027a-e055-47b1-bd1f-6878c729795b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:32.291421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-167a027a-e055-47b1-bd1f-6878c729795b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:32.297254 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-167a027a-e055-47b1-bd1f-6878c729795b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:32.297697 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-167a027a-e055-47b1-bd1f-6878c729795b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:32.298525 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-167a027a-e055-47b1-bd1f-6878c729795b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:32.299170 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-167a027a-e055-47b1-bd1f-6878c729795b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:32.589839 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-016014ce-2052-4105-8ea9-a13473090d78 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:32.602441 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-016014ce-2052-4105-8ea9-a13473090d78 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1318 microversion: 2.1 time: 0.440512 Nov 11 20:40:32.603671 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 196/459] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:32 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:32.610265 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5b17342d-fe45-4a1f-a979-c34864a74d57 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:32.611794 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5b17342d-fe45-4a1f-a979-c34864a74d57 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:32.621718 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b17342d-fe45-4a1f-a979-c34864a74d57 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:32.622733 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b17342d-fe45-4a1f-a979-c34864a74d57 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:32.623618 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b17342d-fe45-4a1f-a979-c34864a74d57 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:32.624088 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b17342d-fe45-4a1f-a979-c34864a74d57 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:32.680278 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-167a027a-e055-47b1-bd1f-6878c729795b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:32.690611 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-167a027a-e055-47b1-bd1f-6878c729795b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.403643 Nov 11 20:40:32.691279 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 264/460] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:32 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:32.698462 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-aae719a4-2525-48be-b06c-d94152645dcc req-c78fa05a-c1fb-4d67-9605-0aad06995944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f94aca5-1944-4a8d-99f9-ad3407734fed", "name": "network-vif-deleted", "tag": "11f2000a-1143-430a-b241-6ba0551ca4a1"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:32.700121 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:32.700121 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:32.707811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-aae719a4-2525-48be-b06c-d94152645dcc req-c78fa05a-c1fb-4d67-9605-0aad06995944 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:32.708281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-aae719a4-2525-48be-b06c-d94152645dcc req-c78fa05a-c1fb-4d67-9605-0aad06995944 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:32.719161 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-aae719a4-2525-48be-b06c-d94152645dcc req-c78fa05a-c1fb-4d67-9605-0aad06995944 service nova] Creating event network-vif-deleted:11f2000a-1143-430a-b241-6ba0551ca4a1 for instance 5f94aca5-1944-4a8d-99f9-ad3407734fed on hv-cinder-81764 Nov 11 20:40:32.724809 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-aae719a4-2525-48be-b06c-d94152645dcc req-c78fa05a-c1fb-4d67-9605-0aad06995944 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031354 Nov 11 20:40:32.725965 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 265/461] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:32.744553 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a944a6af-091b-4f1c-aec8-2ddbb73ed55c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:32.745235 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a944a6af-091b-4f1c-aec8-2ddbb73ed55c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:32.751273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a944a6af-091b-4f1c-aec8-2ddbb73ed55c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:32.751881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a944a6af-091b-4f1c-aec8-2ddbb73ed55c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:32.753092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a944a6af-091b-4f1c-aec8-2ddbb73ed55c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:32.753487 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a944a6af-091b-4f1c-aec8-2ddbb73ed55c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:32.937258 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5b17342d-fe45-4a1f-a979-c34864a74d57 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.331780 Nov 11 20:40:32.937420 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a944a6af-091b-4f1c-aec8-2ddbb73ed55c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:32.938208 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 197/462] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:32 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:32.944617 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fa47d7fc-1efb-40b3-bb70-caaf8eff714a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:32.945768 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fa47d7fc-1efb-40b3-bb70-caaf8eff714a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:32.946945 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a944a6af-091b-4f1c-aec8-2ddbb73ed55c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1318 microversion: 2.1 time: 0.205937 Nov 11 20:40:32.953453 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa47d7fc-1efb-40b3-bb70-caaf8eff714a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:32.954122 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa47d7fc-1efb-40b3-bb70-caaf8eff714a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:32.954909 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa47d7fc-1efb-40b3-bb70-caaf8eff714a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:32.955345 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa47d7fc-1efb-40b3-bb70-caaf8eff714a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:32.957067 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 266/463] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:32 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:33.021240 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6f766570-54c0-4ee7-a361-eb00083fb78e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:33.021849 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6f766570-54c0-4ee7-a361-eb00083fb78e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:33.028092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6f766570-54c0-4ee7-a361-eb00083fb78e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:33.028537 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6f766570-54c0-4ee7-a361-eb00083fb78e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:33.029313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6f766570-54c0-4ee7-a361-eb00083fb78e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:33.029761 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6f766570-54c0-4ee7-a361-eb00083fb78e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:33.161310 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fa47d7fc-1efb-40b3-bb70-caaf8eff714a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 32393 microversion: 2.20 time: 0.221252 Nov 11 20:40:33.161967 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 198/464] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:32 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 32393 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:33.231063 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5d3b7693-4dd8-4446-9919-fcd44383031d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:33.231756 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5d3b7693-4dd8-4446-9919-fcd44383031d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:33.239580 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d3b7693-4dd8-4446-9919-fcd44383031d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:33.240143 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d3b7693-4dd8-4446-9919-fcd44383031d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:33.241023 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d3b7693-4dd8-4446-9919-fcd44383031d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:33.241470 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d3b7693-4dd8-4446-9919-fcd44383031d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:33.275017 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d3b7693-4dd8-4446-9919-fcd44383031d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:33.275464 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d3b7693-4dd8-4446-9919-fcd44383031d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:33.275963 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.objects.instance [None req-5d3b7693-4dd8-4446-9919-fcd44383031d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lazy-loading 'fault' on Instance uuid 5f94aca5-1944-4a8d-99f9-ad3407734fed {{(pid=122527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:40:33.549724 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5d3b7693-4dd8-4446-9919-fcd44383031d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e34575bced464692b3eeee216d2b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f318ff0715454413b9ed68f3e56c7bbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:33.555302 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6f766570-54c0-4ee7-a361-eb00083fb78e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:33.559379 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5d3b7693-4dd8-4446-9919-fcd44383031d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 200 len: 1304 microversion: 2.1 time: 0.332229 Nov 11 20:40:33.560063 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 199/465] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:33 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 1304 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:33.567493 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6f766570-54c0-4ee7-a361-eb00083fb78e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.549706 Nov 11 20:40:33.568527 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 267/466] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:33 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:33.619402 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-abc06521-7b35-45cf-aaa0-60c9edd8d925 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:33.620039 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-abc06521-7b35-45cf-aaa0-60c9edd8d925 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:33.626898 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-abc06521-7b35-45cf-aaa0-60c9edd8d925 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:33.627375 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-abc06521-7b35-45cf-aaa0-60c9edd8d925 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:33.628440 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-abc06521-7b35-45cf-aaa0-60c9edd8d925 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:33.628879 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-abc06521-7b35-45cf-aaa0-60c9edd8d925 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:33.711071 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b9dac35b-6f79-48d2-9f54-ef9720d0832e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:33.711627 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b9dac35b-6f79-48d2-9f54-ef9720d0832e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:33.729251 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b9dac35b-6f79-48d2-9f54-ef9720d0832e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:33.730233 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b9dac35b-6f79-48d2-9f54-ef9720d0832e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:33.731297 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b9dac35b-6f79-48d2-9f54-ef9720d0832e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:33.733220 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b9dac35b-6f79-48d2-9f54-ef9720d0832e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:33.899402 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-abc06521-7b35-45cf-aaa0-60c9edd8d925 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:33.907220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-abc06521-7b35-45cf-aaa0-60c9edd8d925 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1318 microversion: 2.1 time: 0.292125 Nov 11 20:40:33.907807 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 200/467] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:33 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:33.950639 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1b4e5948-bfd4-49e2-be62-5f5e8b2c4c03 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:33.951887 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1b4e5948-bfd4-49e2-be62-5f5e8b2c4c03 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:33.958639 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b4e5948-bfd4-49e2-be62-5f5e8b2c4c03 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:33.959521 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b4e5948-bfd4-49e2-be62-5f5e8b2c4c03 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:33.960385 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b4e5948-bfd4-49e2-be62-5f5e8b2c4c03 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:33.960991 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b4e5948-bfd4-49e2-be62-5f5e8b2c4c03 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.046123 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b9dac35b-6f79-48d2-9f54-ef9720d0832e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:34.055672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b9dac35b-6f79-48d2-9f54-ef9720d0832e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.349748 Nov 11 20:40:34.056281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 268/468] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:33 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:34.060713 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-489042f2-3c70-4ca5-8054-a243b4fc3110 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:34.061499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-489042f2-3c70-4ca5-8054-a243b4fc3110 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:34.067986 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-489042f2-3c70-4ca5-8054-a243b4fc3110 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.068464 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-489042f2-3c70-4ca5-8054-a243b4fc3110 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.069335 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-489042f2-3c70-4ca5-8054-a243b4fc3110 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.069758 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-489042f2-3c70-4ca5-8054-a243b4fc3110 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.102199 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1b4e5948-bfd4-49e2-be62-5f5e8b2c4c03 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.156548 Nov 11 20:40:34.102965 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 201/469] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:33 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:40:34.174055 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-af556efb-0a87-431a-a3dc-995c64014033 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:34.175084 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-af556efb-0a87-431a-a3dc-995c64014033 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:34.183037 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-af556efb-0a87-431a-a3dc-995c64014033 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.183482 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-af556efb-0a87-431a-a3dc-995c64014033 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.184310 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-af556efb-0a87-431a-a3dc-995c64014033 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.184741 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-af556efb-0a87-431a-a3dc-995c64014033 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.263059 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-489042f2-3c70-4ca5-8054-a243b4fc3110 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:34.270375 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-489042f2-3c70-4ca5-8054-a243b4fc3110 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1318 microversion: 2.1 time: 0.212816 Nov 11 20:40:34.270944 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 269/470] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:34 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:34.372544 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-af556efb-0a87-431a-a3dc-995c64014033 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 32856 microversion: 2.20 time: 0.202403 Nov 11 20:40:34.373179 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 202/471] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:34 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 32856 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:40:34.577453 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8afc9b30-667f-427b-9eff-aa9db1d79b1d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:34.578138 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8afc9b30-667f-427b-9eff-aa9db1d79b1d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] [instance: 5f94aca5-1944-4a8d-99f9-ad3407734fed] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:34.587837 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-49aa8bb7-6661-4bc4-b21f-4262efddb398 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:34.589181 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-49aa8bb7-6661-4bc4-b21f-4262efddb398 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:34.595569 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8afc9b30-667f-427b-9eff-aa9db1d79b1d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.596037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8afc9b30-667f-427b-9eff-aa9db1d79b1d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.596824 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8afc9b30-667f-427b-9eff-aa9db1d79b1d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.597260 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8afc9b30-667f-427b-9eff-aa9db1d79b1d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.606165 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-49aa8bb7-6661-4bc4-b21f-4262efddb398 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.606623 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-49aa8bb7-6661-4bc4-b21f-4262efddb398 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.607437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-49aa8bb7-6661-4bc4-b21f-4262efddb398 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.607824 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-49aa8bb7-6661-4bc4-b21f-4262efddb398 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.616186 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-8afc9b30-667f-427b-9eff-aa9db1d79b1d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] HTTP exception thrown: Instance 5f94aca5-1944-4a8d-99f9-ad3407734fed could not be found. Nov 11 20:40:34.617095 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8afc9b30-667f-427b-9eff-aa9db1d79b1d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] Returning 404 to user: Instance 5f94aca5-1944-4a8d-99f9-ad3407734fed could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:40:34.618181 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8afc9b30-667f-427b-9eff-aa9db1d79b1d tempest-VolumesNegativeTest-200270256 tempest-VolumesNegativeTest-200270256-project] 10.222.0.61 "GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed" status: 404 len: 111 microversion: 2.1 time: 0.044561 Nov 11 20:40:34.620139 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 270/472] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:34 2021] GET /compute/v2.1/servers/5f94aca5-1944-4a8d-99f9-ad3407734fed => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:40:34.650869 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-021eea8b-8dc6-484a-881f-bab63ab56512 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:34.651871 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-021eea8b-8dc6-484a-881f-bab63ab56512 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:34.659807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-021eea8b-8dc6-484a-881f-bab63ab56512 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.661113 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-021eea8b-8dc6-484a-881f-bab63ab56512 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.661839 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-021eea8b-8dc6-484a-881f-bab63ab56512 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.662359 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-021eea8b-8dc6-484a-881f-bab63ab56512 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.860143 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-49aa8bb7-6661-4bc4-b21f-4262efddb398 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:34.868004 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-021eea8b-8dc6-484a-881f-bab63ab56512 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:34.873193 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-49aa8bb7-6661-4bc4-b21f-4262efddb398 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.289816 Nov 11 20:40:34.874474 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 203/473] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:34 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:34.876664 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-021eea8b-8dc6-484a-881f-bab63ab56512 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1594 microversion: 2.1 time: 0.228822 Nov 11 20:40:34.890066 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 271/474] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:34 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1594 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:34.893633 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-2ebaec4e-4afd-432e-9071-ee574e567bf0 req-30518746-b683-40fc-85b4-9faa5e5f75e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "138b8b00-39e4-462d-ae08-c582c980e976", "tag": "aa053e0f-920f-42dd-bd56-f2d49a9c85f0"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:34.896239 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:34.896239 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:40:34.906736 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-2ebaec4e-4afd-432e-9071-ee574e567bf0 req-30518746-b683-40fc-85b4-9faa5e5f75e3 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.907185 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-2ebaec4e-4afd-432e-9071-ee574e567bf0 req-30518746-b683-40fc-85b4-9faa5e5f75e3 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.921917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-2ebaec4e-4afd-432e-9071-ee574e567bf0 req-30518746-b683-40fc-85b4-9faa5e5f75e3 service nova] Creating event network-changed:aa053e0f-920f-42dd-bd56-f2d49a9c85f0 for instance 138b8b00-39e4-462d-ae08-c582c980e976 on hv-cinder-81764 Nov 11 20:40:34.925460 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2ed7e336-7a9a-4559-bfcd-9e3945cd8cc2 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:34.926252 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2ed7e336-7a9a-4559-bfcd-9e3945cd8cc2 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:34.927351 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-2ebaec4e-4afd-432e-9071-ee574e567bf0 req-30518746-b683-40fc-85b4-9faa5e5f75e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051043 Nov 11 20:40:34.927991 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 204/475] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:34.934066 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2ed7e336-7a9a-4559-bfcd-9e3945cd8cc2 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.934520 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2ed7e336-7a9a-4559-bfcd-9e3945cd8cc2 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:34.935611 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2ed7e336-7a9a-4559-bfcd-9e3945cd8cc2 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:34.936092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2ed7e336-7a9a-4559-bfcd-9e3945cd8cc2 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:35.078709 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7fbd26f7-e92d-4fd5-8728-1dee4295745f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:35.079529 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7fbd26f7-e92d-4fd5-8728-1dee4295745f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:35.088465 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7fbd26f7-e92d-4fd5-8728-1dee4295745f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:35.089503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7fbd26f7-e92d-4fd5-8728-1dee4295745f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:35.091828 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7fbd26f7-e92d-4fd5-8728-1dee4295745f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:35.092397 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7fbd26f7-e92d-4fd5-8728-1dee4295745f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:35.140659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2ed7e336-7a9a-4559-bfcd-9e3945cd8cc2 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:35.152397 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2ed7e336-7a9a-4559-bfcd-9e3945cd8cc2 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1318 microversion: 2.1 time: 0.229829 Nov 11 20:40:35.153103 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 272/476] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:34 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:35.162232 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-41b863a7-838f-4a90-812a-f3910e1bfc19 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:35.168312 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-41b863a7-838f-4a90-812a-f3910e1bfc19 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:35.183802 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-41b863a7-838f-4a90-812a-f3910e1bfc19 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:35.184523 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-41b863a7-838f-4a90-812a-f3910e1bfc19 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:35.185508 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-41b863a7-838f-4a90-812a-f3910e1bfc19 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:35.188221 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-41b863a7-838f-4a90-812a-f3910e1bfc19 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:35.359291 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-41b863a7-838f-4a90-812a-f3910e1bfc19 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.203191 Nov 11 20:40:35.360400 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 273/477] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:35 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:35.366329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7fbd26f7-e92d-4fd5-8728-1dee4295745f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:35.367211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-72cef511-cec5-4847-89eb-bed84f9b161c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:35.370394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-72cef511-cec5-4847-89eb-bed84f9b161c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:35.374321 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7fbd26f7-e92d-4fd5-8728-1dee4295745f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.303887 Nov 11 20:40:35.385419 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-72cef511-cec5-4847-89eb-bed84f9b161c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:35.385419 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-72cef511-cec5-4847-89eb-bed84f9b161c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:35.386049 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-72cef511-cec5-4847-89eb-bed84f9b161c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:35.388805 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-72cef511-cec5-4847-89eb-bed84f9b161c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:35.389295 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 205/478] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:35 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:35.395241 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c3411e88-574c-4ba0-a945-24a36f1f0563 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:35.396285 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c3411e88-574c-4ba0-a945-24a36f1f0563 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:35.417688 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c3411e88-574c-4ba0-a945-24a36f1f0563 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:35.418146 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c3411e88-574c-4ba0-a945-24a36f1f0563 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:35.418951 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c3411e88-574c-4ba0-a945-24a36f1f0563 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:35.419390 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c3411e88-574c-4ba0-a945-24a36f1f0563 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:35.613548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-72cef511-cec5-4847-89eb-bed84f9b161c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:35.623218 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-72cef511-cec5-4847-89eb-bed84f9b161c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1508 microversion: 2.1 time: 0.261546 Nov 11 20:40:35.623922 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 274/479] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:35 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1508 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:35.678884 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c3411e88-574c-4ba0-a945-24a36f1f0563 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 33190 microversion: 2.20 time: 0.287386 Nov 11 20:40:35.685104 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 206/480] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:35 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 33190 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:35.892439 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fbe1594f-c22a-4462-acad-1227dd75ae5c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:35.893234 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fbe1594f-c22a-4462-acad-1227dd75ae5c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:35.903054 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbe1594f-c22a-4462-acad-1227dd75ae5c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:35.903960 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbe1594f-c22a-4462-acad-1227dd75ae5c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:35.905056 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbe1594f-c22a-4462-acad-1227dd75ae5c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:35.906063 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbe1594f-c22a-4462-acad-1227dd75ae5c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:36.170274 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3a596554-e167-4dbb-9f38-bcc0231eb010 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:36.170967 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3a596554-e167-4dbb-9f38-bcc0231eb010 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:36.181411 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3a596554-e167-4dbb-9f38-bcc0231eb010 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:36.181874 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3a596554-e167-4dbb-9f38-bcc0231eb010 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:36.182645 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3a596554-e167-4dbb-9f38-bcc0231eb010 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:36.183077 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3a596554-e167-4dbb-9f38-bcc0231eb010 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:36.195632 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fbe1594f-c22a-4462-acad-1227dd75ae5c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:36.205161 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fbe1594f-c22a-4462-acad-1227dd75ae5c tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.318090 Nov 11 20:40:36.216318 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 275/481] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:35 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:36.350723 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3a596554-e167-4dbb-9f38-bcc0231eb010 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:36.361240 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3a596554-e167-4dbb-9f38-bcc0231eb010 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1318 microversion: 2.1 time: 0.195052 Nov 11 20:40:36.361832 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 207/482] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:36 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:36.372248 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ea893dc9-49f8-4a17-b1c6-6ca6243b01b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:36.373140 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ea893dc9-49f8-4a17-b1c6-6ca6243b01b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:36.379781 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ea893dc9-49f8-4a17-b1c6-6ca6243b01b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:36.380370 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ea893dc9-49f8-4a17-b1c6-6ca6243b01b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:36.381164 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ea893dc9-49f8-4a17-b1c6-6ca6243b01b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:36.381589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ea893dc9-49f8-4a17-b1c6-6ca6243b01b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:36.393086 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-86626cd2-fd98-467e-8cbd-1e8d69e96785 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:36.393961 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-86626cd2-fd98-467e-8cbd-1e8d69e96785 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:36.406750 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-86626cd2-fd98-467e-8cbd-1e8d69e96785 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:36.407077 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-86626cd2-fd98-467e-8cbd-1e8d69e96785 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:36.408198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-86626cd2-fd98-467e-8cbd-1e8d69e96785 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:36.414468 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-86626cd2-fd98-467e-8cbd-1e8d69e96785 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:36.534114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ea893dc9-49f8-4a17-b1c6-6ca6243b01b9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.167213 Nov 11 20:40:36.534775 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 276/483] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:36 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:36.577870 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-86626cd2-fd98-467e-8cbd-1e8d69e96785 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:36.586079 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-86626cd2-fd98-467e-8cbd-1e8d69e96785 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.196822 Nov 11 20:40:36.595270 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 208/484] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:36 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:36.693714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-912cdebc-9d28-43ec-ab76-942389971b3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:36.694746 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-912cdebc-9d28-43ec-ab76-942389971b3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:36.701952 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-912cdebc-9d28-43ec-ab76-942389971b3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:36.702705 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-912cdebc-9d28-43ec-ab76-942389971b3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:36.703510 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-912cdebc-9d28-43ec-ab76-942389971b3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:36.703943 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-912cdebc-9d28-43ec-ab76-942389971b3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:36.897488 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-912cdebc-9d28-43ec-ab76-942389971b3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 33462 microversion: 2.20 time: 0.208220 Nov 11 20:40:36.898143 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 277/485] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:36 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 33462 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:40:37.145678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9e40df76-a757-44ad-9d17-9b28f4a69a9f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da49ea2b-54f8-49bb-a316-d3ccb5cab811"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:37.157797 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9e40df76-a757-44ad-9d17-9b28f4a69a9f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:37.166822 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9e40df76-a757-44ad-9d17-9b28f4a69a9f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.167487 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9e40df76-a757-44ad-9d17-9b28f4a69a9f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:37.168308 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9e40df76-a757-44ad-9d17-9b28f4a69a9f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.168742 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9e40df76-a757-44ad-9d17-9b28f4a69a9f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:37.224050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6948bb01-2370-48c6-bec1-dd7d47bba3c8 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:37.224981 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6948bb01-2370-48c6-bec1-dd7d47bba3c8 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:37.232273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6948bb01-2370-48c6-bec1-dd7d47bba3c8 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.233060 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6948bb01-2370-48c6-bec1-dd7d47bba3c8 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:37.234007 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6948bb01-2370-48c6-bec1-dd7d47bba3c8 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.234595 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6948bb01-2370-48c6-bec1-dd7d47bba3c8 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:37.408748 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6948bb01-2370-48c6-bec1-dd7d47bba3c8 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:37.418401 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6948bb01-2370-48c6-bec1-dd7d47bba3c8 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.199189 Nov 11 20:40:37.419497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 278/486] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:37 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:37.424393 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ec74950d-08f5-45a0-9605-09bc4418e868 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:37.425347 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ec74950d-08f5-45a0-9605-09bc4418e868 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:37.433804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ec74950d-08f5-45a0-9605-09bc4418e868 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.434560 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ec74950d-08f5-45a0-9605-09bc4418e868 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:37.435584 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ec74950d-08f5-45a0-9605-09bc4418e868 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.436403 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ec74950d-08f5-45a0-9605-09bc4418e868 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:37.549127 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9e40df76-a757-44ad-9d17-9b28f4a69a9f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "POST /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407543 Nov 11 20:40:37.552431 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 209/487] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:40:37 2021] POST /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:37.569155 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-1a76c79b-f191-4e00-a626-5595f654caef req-78c099a5-c29f-4937-935e-fb8453c66b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28d94ff-cfbb-46b3-b20d-32a6cb35893e", "tag": "30542ce7-fdf6-41e0-981e-8ee1bf98723f"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:37.571112 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:37.571112 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:40:37.601331 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-1a76c79b-f191-4e00-a626-5595f654caef req-78c099a5-c29f-4937-935e-fb8453c66b49 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.602810 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-1a76c79b-f191-4e00-a626-5595f654caef req-78c099a5-c29f-4937-935e-fb8453c66b49 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:37.632837 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-1a76c79b-f191-4e00-a626-5595f654caef req-78c099a5-c29f-4937-935e-fb8453c66b49 service nova] Creating event network-changed:30542ce7-fdf6-41e0-981e-8ee1bf98723f for instance d28d94ff-cfbb-46b3-b20d-32a6cb35893e on hv-cinder-81764 Nov 11 20:40:37.642345 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-1a76c79b-f191-4e00-a626-5595f654caef req-78c099a5-c29f-4937-935e-fb8453c66b49 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088240 Nov 11 20:40:37.646238 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 210/488] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:37.654837 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6656a95b-aa75-4cd0-8c22-09585bfd8332 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:37.655848 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6656a95b-aa75-4cd0-8c22-09585bfd8332 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:37.680571 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6656a95b-aa75-4cd0-8c22-09585bfd8332 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.681286 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6656a95b-aa75-4cd0-8c22-09585bfd8332 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:37.682611 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6656a95b-aa75-4cd0-8c22-09585bfd8332 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.683312 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6656a95b-aa75-4cd0-8c22-09585bfd8332 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:37.717620 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ec74950d-08f5-45a0-9605-09bc4418e868 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:37.729581 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ec74950d-08f5-45a0-9605-09bc4418e868 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1318 microversion: 2.1 time: 0.308604 Nov 11 20:40:37.731281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 279/489] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:37 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:37.737957 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-126c47d6-4ab4-4bb9-8114-09d8760f1719 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:37.739920 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-126c47d6-4ab4-4bb9-8114-09d8760f1719 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:37.747941 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-126c47d6-4ab4-4bb9-8114-09d8760f1719 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.748987 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-126c47d6-4ab4-4bb9-8114-09d8760f1719 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:37.750579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-126c47d6-4ab4-4bb9-8114-09d8760f1719 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.751283 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-126c47d6-4ab4-4bb9-8114-09d8760f1719 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:37.846626 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6656a95b-aa75-4cd0-8c22-09585bfd8332 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.196837 Nov 11 20:40:37.847255 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 211/490] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:37 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:37.916402 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fd864aa4-f2fd-4776-ac96-2fd330f5ffaf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:37.918316 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fd864aa4-f2fd-4776-ac96-2fd330f5ffaf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:37.932324 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fd864aa4-f2fd-4776-ac96-2fd330f5ffaf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.932871 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fd864aa4-f2fd-4776-ac96-2fd330f5ffaf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:37.933788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fd864aa4-f2fd-4776-ac96-2fd330f5ffaf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:37.934319 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fd864aa4-f2fd-4776-ac96-2fd330f5ffaf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:38.065761 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-126c47d6-4ab4-4bb9-8114-09d8760f1719 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:38.073878 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-126c47d6-4ab4-4bb9-8114-09d8760f1719 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.341163 Nov 11 20:40:38.074479 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 280/491] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:37 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:38.157743 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fd864aa4-f2fd-4776-ac96-2fd330f5ffaf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 33717 microversion: 2.20 time: 0.248693 Nov 11 20:40:38.158409 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 212/492] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:37 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 33717 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:38.443496 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5c2b026c-e902-483d-a65c-e63b72e6f141 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:38.445000 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5c2b026c-e902-483d-a65c-e63b72e6f141 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:38.453359 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c2b026c-e902-483d-a65c-e63b72e6f141 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:38.454092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c2b026c-e902-483d-a65c-e63b72e6f141 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:38.455845 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c2b026c-e902-483d-a65c-e63b72e6f141 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:38.456534 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c2b026c-e902-483d-a65c-e63b72e6f141 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:38.753071 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b5207364-4b38-4aff-8553-0c05236c1752 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:38.753832 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5c2b026c-e902-483d-a65c-e63b72e6f141 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:38.754481 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b5207364-4b38-4aff-8553-0c05236c1752 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:38.761957 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b5207364-4b38-4aff-8553-0c05236c1752 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:38.762409 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b5207364-4b38-4aff-8553-0c05236c1752 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:38.763207 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b5207364-4b38-4aff-8553-0c05236c1752 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:38.763631 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b5207364-4b38-4aff-8553-0c05236c1752 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:38.769168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5c2b026c-e902-483d-a65c-e63b72e6f141 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.329519 Nov 11 20:40:38.770789 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 281/493] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:38 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:38.866111 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-27ddfc43-8f2c-4426-b31a-5f445f6954a9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:38.867162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-27ddfc43-8f2c-4426-b31a-5f445f6954a9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:38.873669 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-27ddfc43-8f2c-4426-b31a-5f445f6954a9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:38.874516 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-27ddfc43-8f2c-4426-b31a-5f445f6954a9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:38.875564 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-27ddfc43-8f2c-4426-b31a-5f445f6954a9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:38.876187 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-27ddfc43-8f2c-4426-b31a-5f445f6954a9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:38.959032 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b5207364-4b38-4aff-8553-0c05236c1752 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:38.977531 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b5207364-4b38-4aff-8553-0c05236c1752 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1318 microversion: 2.1 time: 0.232738 Nov 11 20:40:38.987683 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 213/494] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:38 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:38.989219 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-27ddfc43-8f2c-4426-b31a-5f445f6954a9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.127224 Nov 11 20:40:38.989941 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 282/495] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:38 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:38.994636 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1c0dc1b4-ce90-4de1-a5ed-e52407f32659 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1799895099"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:38.995754 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1c0dc1b4-ce90-4de1-a5ed-e52407f32659 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:39.003715 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1c0dc1b4-ce90-4de1-a5ed-e52407f32659 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:39.004606 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1c0dc1b4-ce90-4de1-a5ed-e52407f32659 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:39.005098 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1c0dc1b4-ce90-4de1-a5ed-e52407f32659 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:39.005913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1c0dc1b4-ce90-4de1-a5ed-e52407f32659 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:39.092723 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-aae9b911-738d-43d3-a1cd-c3ec6985ea23 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:39.093514 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-aae9b911-738d-43d3-a1cd-c3ec6985ea23 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:39.102492 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aae9b911-738d-43d3-a1cd-c3ec6985ea23 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:39.103067 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aae9b911-738d-43d3-a1cd-c3ec6985ea23 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:39.104198 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aae9b911-738d-43d3-a1cd-c3ec6985ea23 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:39.107459 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aae9b911-738d-43d3-a1cd-c3ec6985ea23 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:39.199145 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.network.security_group_api [None req-1c0dc1b4-ce90-4de1-a5ed-e52407f32659 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Adding security group c06bf615-ba67-4bf3-8987-cd2a1eab332f to port 30542ce7-fdf6-41e0-981e-8ee1bf98723f Nov 11 20:40:39.367097 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-aae9b911-738d-43d3-a1cd-c3ec6985ea23 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:39.384303 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-aae9b911-738d-43d3-a1cd-c3ec6985ea23 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.294987 Nov 11 20:40:39.385976 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 283/496] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:39 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:39.393040 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fc860a83-00fb-4bed-b7b8-cc544865f9c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:39.394410 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fc860a83-00fb-4bed-b7b8-cc544865f9c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:39.406115 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fc860a83-00fb-4bed-b7b8-cc544865f9c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:39.406571 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fc860a83-00fb-4bed-b7b8-cc544865f9c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:39.407776 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fc860a83-00fb-4bed-b7b8-cc544865f9c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:39.409323 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fc860a83-00fb-4bed-b7b8-cc544865f9c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:39.590443 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fc860a83-00fb-4bed-b7b8-cc544865f9c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 34129 microversion: 2.20 time: 0.202152 Nov 11 20:40:39.592096 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 284/497] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:39 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 34129 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:39.599007 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-ae0846f2-28ad-4f38-b9df-3d7f88aacc9b req-5fc50667-215a-4ea3-a68a-138eb99f9a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a68a80-f2c4-48c3-ac43-f1e76012f3ea", "name": "network-vif-plugged", "status": "completed", "tag": "55137242-2e6b-4a3a-a796-20d6c605c358"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:39.603124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:39.603124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:39.610996 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-ae0846f2-28ad-4f38-b9df-3d7f88aacc9b req-5fc50667-215a-4ea3-a68a-138eb99f9a1e service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:39.611437 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-ae0846f2-28ad-4f38-b9df-3d7f88aacc9b req-5fc50667-215a-4ea3-a68a-138eb99f9a1e service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:39.626790 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-ae0846f2-28ad-4f38-b9df-3d7f88aacc9b req-5fc50667-215a-4ea3-a68a-138eb99f9a1e service nova] Creating event network-vif-plugged:55137242-2e6b-4a3a-a796-20d6c605c358 for instance 88a68a80-f2c4-48c3-ac43-f1e76012f3ea on hv-cinder-81764 Nov 11 20:40:39.633132 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-ae0846f2-28ad-4f38-b9df-3d7f88aacc9b req-5fc50667-215a-4ea3-a68a-138eb99f9a1e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039603 Nov 11 20:40:39.634299 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 285/498] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:39.684747 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1c0dc1b4-ce90-4de1-a5ed-e52407f32659 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "POST /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/action" status: 202 len: 0 microversion: 2.1 time: 0.701531 Nov 11 20:40:39.685934 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 214/499] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:38 2021] POST /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:39.694605 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-9a2f1db2-95a8-4be1-8772-24aea1042737 req-e79f4708-717b-46d5-8b5f-8296b578f8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28d94ff-cfbb-46b3-b20d-32a6cb35893e", "tag": "30542ce7-fdf6-41e0-981e-8ee1bf98723f"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:39.695576 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f6a18572-b157-4eff-97c1-ead4eb106fd4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:39.697158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:39.697158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:39.698258 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f6a18572-b157-4eff-97c1-ead4eb106fd4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:39.705746 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f6a18572-b157-4eff-97c1-ead4eb106fd4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:39.706348 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f6a18572-b157-4eff-97c1-ead4eb106fd4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:39.707321 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f6a18572-b157-4eff-97c1-ead4eb106fd4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:39.708525 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f6a18572-b157-4eff-97c1-ead4eb106fd4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:39.708818 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-9a2f1db2-95a8-4be1-8772-24aea1042737 req-e79f4708-717b-46d5-8b5f-8296b578f8b2 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:39.709555 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-9a2f1db2-95a8-4be1-8772-24aea1042737 req-e79f4708-717b-46d5-8b5f-8296b578f8b2 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:39.723247 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-9a2f1db2-95a8-4be1-8772-24aea1042737 req-e79f4708-717b-46d5-8b5f-8296b578f8b2 service nova] Creating event network-changed:30542ce7-fdf6-41e0-981e-8ee1bf98723f for instance d28d94ff-cfbb-46b3-b20d-32a6cb35893e on hv-cinder-81764 Nov 11 20:40:39.730266 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-9a2f1db2-95a8-4be1-8772-24aea1042737 req-e79f4708-717b-46d5-8b5f-8296b578f8b2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041794 Nov 11 20:40:39.731562 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 286/500] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:39.789438 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-82546cef-e86a-49b5-aaa2-a7b20c7ecb68 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:39.790212 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-82546cef-e86a-49b5-aaa2-a7b20c7ecb68 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:39.803260 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-82546cef-e86a-49b5-aaa2-a7b20c7ecb68 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:39.804160 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-82546cef-e86a-49b5-aaa2-a7b20c7ecb68 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:39.806043 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-82546cef-e86a-49b5-aaa2-a7b20c7ecb68 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:39.806589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-82546cef-e86a-49b5-aaa2-a7b20c7ecb68 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:40.134132 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f6a18572-b157-4eff-97c1-ead4eb106fd4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:40.148246 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f6a18572-b157-4eff-97c1-ead4eb106fd4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1760 microversion: 2.1 time: 0.457692 Nov 11 20:40:40.167785 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 215/501] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:39 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1760 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:40.179008 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4770bdf8-a181-4431-9c90-acd13f3efae7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:40.179902 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4770bdf8-a181-4431-9c90-acd13f3efae7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:40.186987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4770bdf8-a181-4431-9c90-acd13f3efae7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:40.187678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4770bdf8-a181-4431-9c90-acd13f3efae7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:40.188839 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4770bdf8-a181-4431-9c90-acd13f3efae7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:40.189458 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4770bdf8-a181-4431-9c90-acd13f3efae7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:40.356342 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-82546cef-e86a-49b5-aaa2-a7b20c7ecb68 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:40.367864 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-82546cef-e86a-49b5-aaa2-a7b20c7ecb68 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.584322 Nov 11 20:40:40.369011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 287/502] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:39 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:40.378524 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-322474a2-161f-432f-aec6-58210a037901 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:40.380314 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-322474a2-161f-432f-aec6-58210a037901 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:40.389825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-322474a2-161f-432f-aec6-58210a037901 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:40.390544 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-322474a2-161f-432f-aec6-58210a037901 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:40.397553 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-322474a2-161f-432f-aec6-58210a037901 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:40.399097 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-322474a2-161f-432f-aec6-58210a037901 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:40.580142 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-4770bdf8-a181-4431-9c90-acd13f3efae7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:40.591636 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4770bdf8-a181-4431-9c90-acd13f3efae7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1318 microversion: 2.1 time: 0.421545 Nov 11 20:40:40.592593 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 216/503] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:40 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:40.602505 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fd724ab3-ff0a-45c0-add9-4a43f5e450e5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:40.604044 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fd724ab3-ff0a-45c0-add9-4a43f5e450e5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:40.610479 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fd724ab3-ff0a-45c0-add9-4a43f5e450e5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:40.611314 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fd724ab3-ff0a-45c0-add9-4a43f5e450e5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:40.612404 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fd724ab3-ff0a-45c0-add9-4a43f5e450e5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:40.613082 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fd724ab3-ff0a-45c0-add9-4a43f5e450e5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:40.775323 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-fd724ab3-ff0a-45c0-add9-4a43f5e450e5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:40.782763 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fd724ab3-ff0a-45c0-add9-4a43f5e450e5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.188800 Nov 11 20:40:40.783338 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 217/504] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:40 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:40.787950 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-181d1120-444e-4031-b696-84574f85b9d5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:40.788957 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-181d1120-444e-4031-b696-84574f85b9d5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:40.798874 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-181d1120-444e-4031-b696-84574f85b9d5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:40.799524 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-181d1120-444e-4031-b696-84574f85b9d5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:40.800651 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-181d1120-444e-4031-b696-84574f85b9d5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:40.801467 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-181d1120-444e-4031-b696-84574f85b9d5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:41.048201 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-181d1120-444e-4031-b696-84574f85b9d5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 34731 microversion: 2.20 time: 0.263536 Nov 11 20:40:41.048856 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 218/505] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:40 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 34731 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:41.054174 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-322474a2-161f-432f-aec6-58210a037901 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.683128 Nov 11 20:40:41.054809 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 288/506] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:40 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:41.388680 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-acdb36e3-491c-410b-b749-66c813c11120 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:41.389447 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-acdb36e3-491c-410b-b749-66c813c11120 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:41.396171 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-acdb36e3-491c-410b-b749-66c813c11120 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:41.396611 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-acdb36e3-491c-410b-b749-66c813c11120 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:41.397381 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-acdb36e3-491c-410b-b749-66c813c11120 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:41.397808 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-acdb36e3-491c-410b-b749-66c813c11120 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:41.530819 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-acdb36e3-491c-410b-b749-66c813c11120 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:41.539038 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-acdb36e3-491c-410b-b749-66c813c11120 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.154305 Nov 11 20:40:41.539604 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 219/507] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:41 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:41.612292 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-97ce00e3-848e-49b5-b700-7f9d83e29709 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:41.612972 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-97ce00e3-848e-49b5-b700-7f9d83e29709 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:41.620576 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97ce00e3-848e-49b5-b700-7f9d83e29709 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:41.621022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97ce00e3-848e-49b5-b700-7f9d83e29709 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:41.621801 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97ce00e3-848e-49b5-b700-7f9d83e29709 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:41.622232 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-97ce00e3-848e-49b5-b700-7f9d83e29709 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:41.763046 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-97ce00e3-848e-49b5-b700-7f9d83e29709 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:41.770567 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-97ce00e3-848e-49b5-b700-7f9d83e29709 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1318 microversion: 2.1 time: 0.162183 Nov 11 20:40:41.771230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 289/508] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:41 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:41.800044 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f93f1de9-42b5-4b0e-b028-3043f28ad28e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:41.800621 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f93f1de9-42b5-4b0e-b028-3043f28ad28e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:41.808300 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f93f1de9-42b5-4b0e-b028-3043f28ad28e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:41.808823 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f93f1de9-42b5-4b0e-b028-3043f28ad28e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:41.809561 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f93f1de9-42b5-4b0e-b028-3043f28ad28e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:41.810005 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f93f1de9-42b5-4b0e-b028-3043f28ad28e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:41.942559 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f93f1de9-42b5-4b0e-b028-3043f28ad28e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:41.956577 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f93f1de9-42b5-4b0e-b028-3043f28ad28e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.160149 Nov 11 20:40:41.959586 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 220/509] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:41 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:42.062239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5c0e86ee-7a81-4b12-9b55-baf4397a694d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:42.063289 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5c0e86ee-7a81-4b12-9b55-baf4397a694d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:42.064583 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-aba98a29-a69c-4d05-962c-6a5dae2ab7e1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:42.065494 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-aba98a29-a69c-4d05-962c-6a5dae2ab7e1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:42.069971 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c0e86ee-7a81-4b12-9b55-baf4397a694d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:42.070422 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c0e86ee-7a81-4b12-9b55-baf4397a694d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:42.071218 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c0e86ee-7a81-4b12-9b55-baf4397a694d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:42.071653 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c0e86ee-7a81-4b12-9b55-baf4397a694d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:42.072298 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aba98a29-a69c-4d05-962c-6a5dae2ab7e1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:42.072746 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aba98a29-a69c-4d05-962c-6a5dae2ab7e1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:42.073525 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aba98a29-a69c-4d05-962c-6a5dae2ab7e1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:42.074015 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aba98a29-a69c-4d05-962c-6a5dae2ab7e1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:42.209024 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-aba98a29-a69c-4d05-962c-6a5dae2ab7e1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.147775 Nov 11 20:40:42.209572 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 221/510] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:42 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:40:42.258504 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5c0e86ee-7a81-4b12-9b55-baf4397a694d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 35032 microversion: 2.20 time: 0.199703 Nov 11 20:40:42.259397 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 290/511] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:42 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 35032 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:42.556997 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f4aa27c2-243c-46a1-afe7-642bce417017 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:42.557630 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f4aa27c2-243c-46a1-afe7-642bce417017 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:42.564427 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f4aa27c2-243c-46a1-afe7-642bce417017 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:42.564873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f4aa27c2-243c-46a1-afe7-642bce417017 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:42.565702 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f4aa27c2-243c-46a1-afe7-642bce417017 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:42.566130 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f4aa27c2-243c-46a1-afe7-642bce417017 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:42.707219 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f4aa27c2-243c-46a1-afe7-642bce417017 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:42.714609 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f4aa27c2-243c-46a1-afe7-642bce417017 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.161891 Nov 11 20:40:42.715171 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 222/512] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:42 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:42.788071 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d927f1e0-c435-44fc-9d9b-99ad373972eb tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:42.788759 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d927f1e0-c435-44fc-9d9b-99ad373972eb tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:42.795681 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d927f1e0-c435-44fc-9d9b-99ad373972eb tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:42.796156 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d927f1e0-c435-44fc-9d9b-99ad373972eb tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:42.796923 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d927f1e0-c435-44fc-9d9b-99ad373972eb tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:42.797378 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d927f1e0-c435-44fc-9d9b-99ad373972eb tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:42.934856 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d927f1e0-c435-44fc-9d9b-99ad373972eb tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:42.943263 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d927f1e0-c435-44fc-9d9b-99ad373972eb tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1318 microversion: 2.1 time: 0.158934 Nov 11 20:40:42.944034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 291/513] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:42 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:42.981830 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e0b22f75-070d-448d-9896-8b4a294b6746 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:42.982427 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e0b22f75-070d-448d-9896-8b4a294b6746 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:42.990158 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e0b22f75-070d-448d-9896-8b4a294b6746 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:42.990569 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e0b22f75-070d-448d-9896-8b4a294b6746 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:42.991360 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e0b22f75-070d-448d-9896-8b4a294b6746 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:42.991788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e0b22f75-070d-448d-9896-8b4a294b6746 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:43.144220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e0b22f75-070d-448d-9896-8b4a294b6746 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:43.152380 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e0b22f75-070d-448d-9896-8b4a294b6746 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.174113 Nov 11 20:40:43.152951 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 223/514] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:42 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:43.220718 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b07efff7-f015-4616-853e-c6c95a17f3c7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:43.221643 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b07efff7-f015-4616-853e-c6c95a17f3c7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:43.237895 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b07efff7-f015-4616-853e-c6c95a17f3c7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:43.238354 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b07efff7-f015-4616-853e-c6c95a17f3c7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:43.240021 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b07efff7-f015-4616-853e-c6c95a17f3c7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:43.240468 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b07efff7-f015-4616-853e-c6c95a17f3c7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:43.267525 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-9ea7de5c-1a65-4ed1-9d0d-5c01ceb6ee46 req-db0e652b-7490-45ce-acf9-547602f68a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138b8b00-39e4-462d-ae08-c582c980e976", "name": "network-vif-plugged", "status": "completed", "tag": "aa053e0f-920f-42dd-bd56-f2d49a9c85f0"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:43.269580 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:43.269580 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:40:43.278258 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-9ea7de5c-1a65-4ed1-9d0d-5c01ceb6ee46 req-db0e652b-7490-45ce-acf9-547602f68a8f service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:43.278774 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-9ea7de5c-1a65-4ed1-9d0d-5c01ceb6ee46 req-db0e652b-7490-45ce-acf9-547602f68a8f service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:43.291251 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-9ea7de5c-1a65-4ed1-9d0d-5c01ceb6ee46 req-db0e652b-7490-45ce-acf9-547602f68a8f service nova] Creating event network-vif-plugged:aa053e0f-920f-42dd-bd56-f2d49a9c85f0 for instance 138b8b00-39e4-462d-ae08-c582c980e976 on hv-cinder-81764 Nov 11 20:40:43.295935 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-9ea7de5c-1a65-4ed1-9d0d-5c01ceb6ee46 req-db0e652b-7490-45ce-acf9-547602f68a8f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032980 Nov 11 20:40:43.296549 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 224/515] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:43.302147 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4ad733a2-d827-4676-979b-bbe94c649b18 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:43.303105 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4ad733a2-d827-4676-979b-bbe94c649b18 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:43.309275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4ad733a2-d827-4676-979b-bbe94c649b18 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:43.309717 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4ad733a2-d827-4676-979b-bbe94c649b18 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:43.310562 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4ad733a2-d827-4676-979b-bbe94c649b18 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:43.310996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4ad733a2-d827-4676-979b-bbe94c649b18 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:43.435497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b07efff7-f015-4616-853e-c6c95a17f3c7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.218285 Nov 11 20:40:43.436297 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 292/516] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:43 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:43.600292 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4ad733a2-d827-4676-979b-bbe94c649b18 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 35475 microversion: 2.20 time: 0.302173 Nov 11 20:40:43.600996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 225/517] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:43 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 35475 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:43.731022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ef142343-6333-4cf1-a8f1-6befad5c0a10 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:43.731717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ef142343-6333-4cf1-a8f1-6befad5c0a10 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:43.738665 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ef142343-6333-4cf1-a8f1-6befad5c0a10 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:43.739113 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ef142343-6333-4cf1-a8f1-6befad5c0a10 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:43.740040 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ef142343-6333-4cf1-a8f1-6befad5c0a10 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:43.740482 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ef142343-6333-4cf1-a8f1-6befad5c0a10 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:43.883896 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ef142343-6333-4cf1-a8f1-6befad5c0a10 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:43.891603 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ef142343-6333-4cf1-a8f1-6befad5c0a10 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.164546 Nov 11 20:40:43.892384 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 293/518] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:43 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:43.962464 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f616fd54-8429-4a50-8bba-1eaadc798c2e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:43.963065 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f616fd54-8429-4a50-8bba-1eaadc798c2e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:43.970137 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f616fd54-8429-4a50-8bba-1eaadc798c2e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:43.970577 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f616fd54-8429-4a50-8bba-1eaadc798c2e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:43.971574 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f616fd54-8429-4a50-8bba-1eaadc798c2e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:43.972035 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f616fd54-8429-4a50-8bba-1eaadc798c2e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:44.121438 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f616fd54-8429-4a50-8bba-1eaadc798c2e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:44.128798 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f616fd54-8429-4a50-8bba-1eaadc798c2e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1507 microversion: 2.1 time: 0.171369 Nov 11 20:40:44.129430 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 226/519] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:43 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:44.170970 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bee26f23-4209-4359-aed5-61c6eb8be496 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:44.171184 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-bee26f23-4209-4359-aed5-61c6eb8be496 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:44.178664 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bee26f23-4209-4359-aed5-61c6eb8be496 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:44.179410 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bee26f23-4209-4359-aed5-61c6eb8be496 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:44.180252 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bee26f23-4209-4359-aed5-61c6eb8be496 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:44.180683 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bee26f23-4209-4359-aed5-61c6eb8be496 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:44.449071 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a8e847ef-1f47-429c-adae-5697c45a6105 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:44.450167 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a8e847ef-1f47-429c-adae-5697c45a6105 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:44.458900 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a8e847ef-1f47-429c-adae-5697c45a6105 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:44.459602 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a8e847ef-1f47-429c-adae-5697c45a6105 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:44.460596 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a8e847ef-1f47-429c-adae-5697c45a6105 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:44.462707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a8e847ef-1f47-429c-adae-5697c45a6105 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:44.589592 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-bee26f23-4209-4359-aed5-61c6eb8be496 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:44.598886 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bee26f23-4209-4359-aed5-61c6eb8be496 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.431402 Nov 11 20:40:44.601800 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 294/520] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:44 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:44.613638 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-873db17f-5ff8-4f91-b298-0f24b630a070 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:44.615251 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-873db17f-5ff8-4f91-b298-0f24b630a070 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:44.621406 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-873db17f-5ff8-4f91-b298-0f24b630a070 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:44.621966 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-873db17f-5ff8-4f91-b298-0f24b630a070 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:44.622839 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-873db17f-5ff8-4f91-b298-0f24b630a070 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:44.623350 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-873db17f-5ff8-4f91-b298-0f24b630a070 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:44.652162 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a8e847ef-1f47-429c-adae-5697c45a6105 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.206145 Nov 11 20:40:44.653568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 227/521] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:44 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:40:44.840710 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-873db17f-5ff8-4f91-b298-0f24b630a070 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 35846 microversion: 2.20 time: 0.231202 Nov 11 20:40:44.841365 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 295/522] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:44 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 35846 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:44.911856 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6db76d5d-aa13-445a-b567-3a849dd6de07 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:44.912577 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6db76d5d-aa13-445a-b567-3a849dd6de07 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:44.919397 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6db76d5d-aa13-445a-b567-3a849dd6de07 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:44.919839 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6db76d5d-aa13-445a-b567-3a849dd6de07 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:44.920640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6db76d5d-aa13-445a-b567-3a849dd6de07 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:44.921073 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6db76d5d-aa13-445a-b567-3a849dd6de07 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:45.071315 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-6db76d5d-aa13-445a-b567-3a849dd6de07 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:45.079549 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6db76d5d-aa13-445a-b567-3a849dd6de07 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.172117 Nov 11 20:40:45.079863 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 228/523] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:44 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:45.618704 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4fb7de1b-1865-49e4-b1b8-8cadcfbb54a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:45.619386 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4fb7de1b-1865-49e4-b1b8-8cadcfbb54a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:45.626403 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4fb7de1b-1865-49e4-b1b8-8cadcfbb54a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:45.626845 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4fb7de1b-1865-49e4-b1b8-8cadcfbb54a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:45.627619 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4fb7de1b-1865-49e4-b1b8-8cadcfbb54a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:45.628078 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4fb7de1b-1865-49e4-b1b8-8cadcfbb54a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:45.669120 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-251447ee-512b-4db0-aedb-33053b5afb28 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:45.670041 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-251447ee-512b-4db0-aedb-33053b5afb28 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:45.677446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-251447ee-512b-4db0-aedb-33053b5afb28 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:45.677895 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-251447ee-512b-4db0-aedb-33053b5afb28 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:45.678760 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-251447ee-512b-4db0-aedb-33053b5afb28 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:45.679130 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-251447ee-512b-4db0-aedb-33053b5afb28 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:45.765134 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4fb7de1b-1865-49e4-b1b8-8cadcfbb54a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:45.773155 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4fb7de1b-1865-49e4-b1b8-8cadcfbb54a8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.158555 Nov 11 20:40:45.773722 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 296/524] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:45 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:45.830825 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-251447ee-512b-4db0-aedb-33053b5afb28 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.165121 Nov 11 20:40:45.831666 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 229/525] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:45 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:40:45.851900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a748d46f-a92b-4009-998d-e43a12e5d6c6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:45.852852 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a748d46f-a92b-4009-998d-e43a12e5d6c6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:45.858779 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a748d46f-a92b-4009-998d-e43a12e5d6c6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:45.859236 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a748d46f-a92b-4009-998d-e43a12e5d6c6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:45.860052 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a748d46f-a92b-4009-998d-e43a12e5d6c6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:45.860489 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a748d46f-a92b-4009-998d-e43a12e5d6c6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:46.089765 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a748d46f-a92b-4009-998d-e43a12e5d6c6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 36252 microversion: 2.20 time: 0.241465 Nov 11 20:40:46.090801 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 297/526] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:45 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 36252 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:40:46.097688 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e2e38c63-5ca3-4bc5-b5c5-3fb60fa9443b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:46.099501 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e2e38c63-5ca3-4bc5-b5c5-3fb60fa9443b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:46.109484 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e2e38c63-5ca3-4bc5-b5c5-3fb60fa9443b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:46.109919 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e2e38c63-5ca3-4bc5-b5c5-3fb60fa9443b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:46.110923 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e2e38c63-5ca3-4bc5-b5c5-3fb60fa9443b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:46.111408 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e2e38c63-5ca3-4bc5-b5c5-3fb60fa9443b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:46.261855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e2e38c63-5ca3-4bc5-b5c5-3fb60fa9443b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:46.269720 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e2e38c63-5ca3-4bc5-b5c5-3fb60fa9443b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.175867 Nov 11 20:40:46.270276 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 230/527] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:46 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:46.790035 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-73ab6cf2-aa37-45ca-bd20-87f92a783e64 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:46.790689 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-73ab6cf2-aa37-45ca-bd20-87f92a783e64 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:46.800098 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-73ab6cf2-aa37-45ca-bd20-87f92a783e64 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:46.800721 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-73ab6cf2-aa37-45ca-bd20-87f92a783e64 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:46.801882 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-73ab6cf2-aa37-45ca-bd20-87f92a783e64 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:46.802591 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-73ab6cf2-aa37-45ca-bd20-87f92a783e64 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:46.841595 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-64899af5-84ad-4b2f-9b4a-4c9d16403cd3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:46.842521 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-64899af5-84ad-4b2f-9b4a-4c9d16403cd3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:46.849515 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-64899af5-84ad-4b2f-9b4a-4c9d16403cd3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:46.850022 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-64899af5-84ad-4b2f-9b4a-4c9d16403cd3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:46.850826 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-64899af5-84ad-4b2f-9b4a-4c9d16403cd3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:46.851265 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-64899af5-84ad-4b2f-9b4a-4c9d16403cd3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:46.944554 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-73ab6cf2-aa37-45ca-bd20-87f92a783e64 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:46.951949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-73ab6cf2-aa37-45ca-bd20-87f92a783e64 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.166443 Nov 11 20:40:46.952832 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 298/528] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:46 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:47.011920 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-64899af5-84ad-4b2f-9b4a-4c9d16403cd3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.173909 Nov 11 20:40:47.012620 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 231/529] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:46 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:40:47.102784 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3c162359-f126-4111-9c4e-e7cfde889e3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:47.103775 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3c162359-f126-4111-9c4e-e7cfde889e3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:47.110241 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3c162359-f126-4111-9c4e-e7cfde889e3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:47.110699 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3c162359-f126-4111-9c4e-e7cfde889e3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:47.111536 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3c162359-f126-4111-9c4e-e7cfde889e3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:47.112018 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3c162359-f126-4111-9c4e-e7cfde889e3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:47.284106 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-791b2651-23af-4c0f-a9da-adff3036dd14 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da49ea2b-54f8-49bb-a316-d3ccb5cab811"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:47.285250 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-791b2651-23af-4c0f-a9da-adff3036dd14 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:47.292335 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-791b2651-23af-4c0f-a9da-adff3036dd14 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:47.292776 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-791b2651-23af-4c0f-a9da-adff3036dd14 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:47.293552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-791b2651-23af-4c0f-a9da-adff3036dd14 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:47.293997 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-791b2651-23af-4c0f-a9da-adff3036dd14 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:47.299317 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3c162359-f126-4111-9c4e-e7cfde889e3b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 36588 microversion: 2.20 time: 0.200321 Nov 11 20:40:47.300445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 299/530] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:47 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 36588 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:47.306280 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a27f6d30-130d-4948-988f-57b74ef9398d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:47.306970 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a27f6d30-130d-4948-988f-57b74ef9398d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:47.313798 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a27f6d30-130d-4948-988f-57b74ef9398d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:47.314240 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a27f6d30-130d-4948-988f-57b74ef9398d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:47.315029 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a27f6d30-130d-4948-988f-57b74ef9398d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:47.315464 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a27f6d30-130d-4948-988f-57b74ef9398d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:47.375986 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-791b2651-23af-4c0f-a9da-adff3036dd14 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] HTTP exception thrown: Invalid volume: volume da49ea2b-54f8-49bb-a316-d3ccb5cab811 is already attached to instances: f872205c-fe9f-4e51-8359-dd7e9e65f155 Nov 11 20:40:47.376597 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-791b2651-23af-4c0f-a9da-adff3036dd14 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Returning 400 to user: Invalid volume: volume da49ea2b-54f8-49bb-a316-d3ccb5cab811 is already attached to instances: f872205c-fe9f-4e51-8359-dd7e9e65f155 {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:40:47.377433 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-791b2651-23af-4c0f-a9da-adff3036dd14 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "POST /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097736 Nov 11 20:40:47.377984 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 232/531] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:40:47 2021] POST /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 11 20:40:47.441318 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1b0683b0-a3b7-47e2-a192-ab6b0849f9fd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:47.442504 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1b0683b0-a3b7-47e2-a192-ab6b0849f9fd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:47.450395 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b0683b0-a3b7-47e2-a192-ab6b0849f9fd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:47.450844 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b0683b0-a3b7-47e2-a192-ab6b0849f9fd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:47.451685 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b0683b0-a3b7-47e2-a192-ab6b0849f9fd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:47.452327 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b0683b0-a3b7-47e2-a192-ab6b0849f9fd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:47.463511 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a27f6d30-130d-4948-988f-57b74ef9398d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:47.471207 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a27f6d30-130d-4948-988f-57b74ef9398d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.168803 Nov 11 20:40:47.471876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 300/532] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:47 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:47.579683 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.objects.instance [None req-1b0683b0-a3b7-47e2-a192-ab6b0849f9fd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lazy-loading 'services' on Instance uuid f872205c-fe9f-4e51-8359-dd7e9e65f155 {{(pid=122527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:40:47.692020 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1b0683b0-a3b7-47e2-a192-ab6b0849f9fd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155/os-volume_attachments/da49ea2b-54f8-49bb-a316-d3ccb5cab811" status: 202 len: 0 microversion: 2.1 time: 0.254777 Nov 11 20:40:47.692981 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 233/533] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Nov 11 20:40:47 2021] DELETE /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155/os-volume_attachments/da49ea2b-54f8-49bb-a316-d3ccb5cab811 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:40:47.701511 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3eecc9b6-72ec-4b09-aef0-72d63e8b5585 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:47.703022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3eecc9b6-72ec-4b09-aef0-72d63e8b5585 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:47.709830 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3eecc9b6-72ec-4b09-aef0-72d63e8b5585 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:47.710290 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3eecc9b6-72ec-4b09-aef0-72d63e8b5585 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:47.711076 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3eecc9b6-72ec-4b09-aef0-72d63e8b5585 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:47.712205 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3eecc9b6-72ec-4b09-aef0-72d63e8b5585 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:47.745612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3eecc9b6-72ec-4b09-aef0-72d63e8b5585 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048143 Nov 11 20:40:47.746387 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 301/534] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:40:47 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:47.970945 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-87f0e79b-8c1e-4568-be5e-a5827faaaaed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:47.970945 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-87f0e79b-8c1e-4568-be5e-a5827faaaaed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:47.978881 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-87f0e79b-8c1e-4568-be5e-a5827faaaaed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:47.979333 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-87f0e79b-8c1e-4568-be5e-a5827faaaaed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:47.980171 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-87f0e79b-8c1e-4568-be5e-a5827faaaaed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:47.980611 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-87f0e79b-8c1e-4568-be5e-a5827faaaaed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:48.025294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3a5774ba-aaec-4b7b-8c18-1863d7189fa9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:48.026211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3a5774ba-aaec-4b7b-8c18-1863d7189fa9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:48.032615 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3a5774ba-aaec-4b7b-8c18-1863d7189fa9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:48.033065 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3a5774ba-aaec-4b7b-8c18-1863d7189fa9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:48.033851 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3a5774ba-aaec-4b7b-8c18-1863d7189fa9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:48.034280 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3a5774ba-aaec-4b7b-8c18-1863d7189fa9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:48.129131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-87f0e79b-8c1e-4568-be5e-a5827faaaaed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:48.136431 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-87f0e79b-8c1e-4568-be5e-a5827faaaaed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.170287 Nov 11 20:40:48.137004 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 234/535] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:47 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:48.235229 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3a5774ba-aaec-4b7b-8c18-1863d7189fa9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.215153 Nov 11 20:40:48.238614 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 302/536] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:48 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:40:48.312024 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ec8c4630-5686-4afd-b255-51afe9552577 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:48.312987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ec8c4630-5686-4afd-b255-51afe9552577 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:48.319375 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ec8c4630-5686-4afd-b255-51afe9552577 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:48.319813 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ec8c4630-5686-4afd-b255-51afe9552577 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:48.320598 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ec8c4630-5686-4afd-b255-51afe9552577 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:48.321028 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ec8c4630-5686-4afd-b255-51afe9552577 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:48.489077 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-edfd24ac-0a16-4530-9b74-b37f8c0d5709 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:48.489687 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-edfd24ac-0a16-4530-9b74-b37f8c0d5709 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:48.496746 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-edfd24ac-0a16-4530-9b74-b37f8c0d5709 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:48.497191 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-edfd24ac-0a16-4530-9b74-b37f8c0d5709 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:48.497965 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-edfd24ac-0a16-4530-9b74-b37f8c0d5709 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:48.498467 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-edfd24ac-0a16-4530-9b74-b37f8c0d5709 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:48.510183 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ec8c4630-5686-4afd-b255-51afe9552577 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 36904 microversion: 2.20 time: 0.201614 Nov 11 20:40:48.514335 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 235/537] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:48 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 36904 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:48.634469 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-edfd24ac-0a16-4530-9b74-b37f8c0d5709 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:48.641591 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-edfd24ac-0a16-4530-9b74-b37f8c0d5709 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.156641 Nov 11 20:40:48.642153 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 303/538] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:48 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:48.758910 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-25491921-dd7d-48fe-91c8-d94c64e56548 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:48.759834 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-25491921-dd7d-48fe-91c8-d94c64e56548 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:48.766764 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-25491921-dd7d-48fe-91c8-d94c64e56548 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:48.767207 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-25491921-dd7d-48fe-91c8-d94c64e56548 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:48.768011 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-25491921-dd7d-48fe-91c8-d94c64e56548 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:48.768451 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-25491921-dd7d-48fe-91c8-d94c64e56548 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:48.798996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-25491921-dd7d-48fe-91c8-d94c64e56548 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045498 Nov 11 20:40:48.799543 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 236/539] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:40:48 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:49.153823 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c5f795c9-7262-496c-80a2-1e67f9cd0cce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:49.154422 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c5f795c9-7262-496c-80a2-1e67f9cd0cce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:49.161344 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c5f795c9-7262-496c-80a2-1e67f9cd0cce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:49.161784 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c5f795c9-7262-496c-80a2-1e67f9cd0cce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:49.162565 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c5f795c9-7262-496c-80a2-1e67f9cd0cce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:49.163195 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c5f795c9-7262-496c-80a2-1e67f9cd0cce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:49.246760 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-000cf56d-0c22-460a-9bf1-86e8e368e0ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:49.247679 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-000cf56d-0c22-460a-9bf1-86e8e368e0ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:49.254006 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-000cf56d-0c22-460a-9bf1-86e8e368e0ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:49.254651 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-000cf56d-0c22-460a-9bf1-86e8e368e0ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:49.255451 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-000cf56d-0c22-460a-9bf1-86e8e368e0ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:49.255886 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-000cf56d-0c22-460a-9bf1-86e8e368e0ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:49.294505 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c5f795c9-7262-496c-80a2-1e67f9cd0cce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:49.302926 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c5f795c9-7262-496c-80a2-1e67f9cd0cce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.152815 Nov 11 20:40:49.303498 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 304/540] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:49 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:49.377748 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-000cf56d-0c22-460a-9bf1-86e8e368e0ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.134716 Nov 11 20:40:49.378381 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 237/541] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:49 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:40:49.523322 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-36a7ef5c-1a5c-497b-aa8e-31082e9430da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:49.524182 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-36a7ef5c-1a5c-497b-aa8e-31082e9430da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:49.530552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-36a7ef5c-1a5c-497b-aa8e-31082e9430da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:49.530998 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-36a7ef5c-1a5c-497b-aa8e-31082e9430da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:49.531773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-36a7ef5c-1a5c-497b-aa8e-31082e9430da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:49.532244 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-36a7ef5c-1a5c-497b-aa8e-31082e9430da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:49.658602 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0d4f4e99-a07a-4d3f-8d21-fb4312e5272b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:49.659296 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0d4f4e99-a07a-4d3f-8d21-fb4312e5272b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:49.666659 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d4f4e99-a07a-4d3f-8d21-fb4312e5272b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:49.667105 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d4f4e99-a07a-4d3f-8d21-fb4312e5272b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:49.667875 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d4f4e99-a07a-4d3f-8d21-fb4312e5272b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:49.668332 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d4f4e99-a07a-4d3f-8d21-fb4312e5272b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:49.720425 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-36a7ef5c-1a5c-497b-aa8e-31082e9430da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 37041 microversion: 2.20 time: 0.201871 Nov 11 20:40:49.721080 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 305/542] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:49 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 37041 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:40:49.803690 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0d4f4e99-a07a-4d3f-8d21-fb4312e5272b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:49.811084 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ed21362b-4c3f-4e82-9c39-98e849f95786 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:49.812098 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ed21362b-4c3f-4e82-9c39-98e849f95786 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:49.813251 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0d4f4e99-a07a-4d3f-8d21-fb4312e5272b tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.158023 Nov 11 20:40:49.814405 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 238/543] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:49 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:49.828109 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ed21362b-4c3f-4e82-9c39-98e849f95786 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:49.828551 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ed21362b-4c3f-4e82-9c39-98e849f95786 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:49.829336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ed21362b-4c3f-4e82-9c39-98e849f95786 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:49.829763 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ed21362b-4c3f-4e82-9c39-98e849f95786 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:49.873643 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ed21362b-4c3f-4e82-9c39-98e849f95786 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066582 Nov 11 20:40:49.874219 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 306/544] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:40:49 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:40:50.019646 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1066476077", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "networks": [{"uuid": "f75b74a3-4944-4e66-a1f1-0eb754745d66"}]}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:50.072704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.network.neutron [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] validate_networks() for [('f75b74a3-4944-4e66-a1f1-0eb754745d66', None, None, None, None, None)] {{(pid=122527) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:40:50.319232 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f99ebb92-4b8d-401a-ba48-8785a4fdda4d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:50.319803 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f99ebb92-4b8d-401a-ba48-8785a4fdda4d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:50.325933 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f99ebb92-4b8d-401a-ba48-8785a4fdda4d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:50.326380 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f99ebb92-4b8d-401a-ba48-8785a4fdda4d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:50.327158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f99ebb92-4b8d-401a-ba48-8785a4fdda4d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:50.327844 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f99ebb92-4b8d-401a-ba48-8785a4fdda4d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:50.497711 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Flavor limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:40:50.498240 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Image limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:40:50.498703 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Flavor pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:40:50.499189 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Image pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:40:50.499664 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:40:50.510430 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:50.510877 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:50.511672 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:50.512271 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:50.532123 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Getting quotas for project 7b92a8a05c22447985ae53c7b9c91fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:40:50.536319 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Getting quotas for user f77c253d448e482db5ecbc453e4e0f3e and project 7b92a8a05c22447985ae53c7b9c91fc8. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:40:50.536588 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f99ebb92-4b8d-401a-ba48-8785a4fdda4d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:50.543902 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f99ebb92-4b8d-401a-ba48-8785a4fdda4d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.228699 Nov 11 20:40:50.544579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 307/545] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:50 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:50.548419 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Going to run 1 instances... {{(pid=122527) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:40:50.548887 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-28ecf3e6-3437-4cfc-85fc-831fb2677443 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:50.549795 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-28ecf3e6-3437-4cfc-85fc-831fb2677443 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:50.550738 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:40:50.555496 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-28ecf3e6-3437-4cfc-85fc-831fb2677443 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:50.555945 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-28ecf3e6-3437-4cfc-85fc-831fb2677443 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:50.556753 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-28ecf3e6-3437-4cfc-85fc-831fb2677443 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:50.557193 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-28ecf3e6-3437-4cfc-85fc-831fb2677443 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:50.602238 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e1af7e74-f794-4617-a37c-1d56f4980458 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586133 Nov 11 20:40:50.603062 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 239/546] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:40:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:40:50.615153 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-388da889-478d-41b9-b615-b1ebda0f1b67 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:50.615895 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-388da889-478d-41b9-b615-b1ebda0f1b67 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:50.675700 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-388da889-478d-41b9-b615-b1ebda0f1b67 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:50.684082 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-388da889-478d-41b9-b615-b1ebda0f1b67 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1218 microversion: 2.1 time: 0.072273 Nov 11 20:40:50.684478 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 240/547] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:50 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:50.732598 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-002b62bd-ccd7-43cc-891d-b8adbf5cd1f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:50.736381 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-002b62bd-ccd7-43cc-891d-b8adbf5cd1f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:50.740366 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-002b62bd-ccd7-43cc-891d-b8adbf5cd1f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:50.740830 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-002b62bd-ccd7-43cc-891d-b8adbf5cd1f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:50.741626 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-002b62bd-ccd7-43cc-891d-b8adbf5cd1f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:50.742062 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-002b62bd-ccd7-43cc-891d-b8adbf5cd1f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:50.763512 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-28ecf3e6-3437-4cfc-85fc-831fb2677443 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.217632 Nov 11 20:40:50.764197 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 308/548] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:50 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:50.832943 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-979715e5-1026-46a3-891b-d820d87fd17e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:50.833644 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-979715e5-1026-46a3-891b-d820d87fd17e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:50.840863 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-979715e5-1026-46a3-891b-d820d87fd17e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:50.841305 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-979715e5-1026-46a3-891b-d820d87fd17e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:50.842114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-979715e5-1026-46a3-891b-d820d87fd17e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:50.842542 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-979715e5-1026-46a3-891b-d820d87fd17e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:50.989127 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-002b62bd-ccd7-43cc-891d-b8adbf5cd1f1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 200 len: 37447 microversion: 2.20 time: 0.259987 Nov 11 20:40:50.990139 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 241/549] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:50 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 37447 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:40:51.001402 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a1e18ba1-68a4-4c83-bbdf-7d1ffcde7b29 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:51.001522 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a1e18ba1-68a4-4c83-bbdf-7d1ffcde7b29 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:51.005926 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-979715e5-1026-46a3-891b-d820d87fd17e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:51.011374 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1e18ba1-68a4-4c83-bbdf-7d1ffcde7b29 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:51.012139 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1e18ba1-68a4-4c83-bbdf-7d1ffcde7b29 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:51.013003 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1e18ba1-68a4-4c83-bbdf-7d1ffcde7b29 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:51.013592 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1e18ba1-68a4-4c83-bbdf-7d1ffcde7b29 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:51.013741 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-979715e5-1026-46a3-891b-d820d87fd17e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1314 microversion: 2.1 time: 0.184942 Nov 11 20:40:51.025076 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 309/550] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:50 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:51.043217 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a1e18ba1-68a4-4c83-bbdf-7d1ffcde7b29 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/ips" status: 200 len: 151 microversion: 2.20 time: 0.046220 Nov 11 20:40:51.043786 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 242/551] 10.222.0.61 () {60 vars in 1288 bytes} [Thu Nov 11 20:40:50 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:40:51.560917 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b511afd4-5931-48a7-a126-abda7af7c51d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:51.561521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b511afd4-5931-48a7-a126-abda7af7c51d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:51.567794 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b511afd4-5931-48a7-a126-abda7af7c51d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:51.568653 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b511afd4-5931-48a7-a126-abda7af7c51d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:51.570026 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b511afd4-5931-48a7-a126-abda7af7c51d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:51.570827 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b511afd4-5931-48a7-a126-abda7af7c51d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:51.703912 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0ee10922-81e7-4dae-8fe2-18a57fa03d2b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:51.704787 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0ee10922-81e7-4dae-8fe2-18a57fa03d2b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:51.712988 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0ee10922-81e7-4dae-8fe2-18a57fa03d2b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:51.713453 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0ee10922-81e7-4dae-8fe2-18a57fa03d2b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:51.713955 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b511afd4-5931-48a7-a126-abda7af7c51d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:51.714250 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0ee10922-81e7-4dae-8fe2-18a57fa03d2b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:51.714720 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0ee10922-81e7-4dae-8fe2-18a57fa03d2b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:51.721990 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b511afd4-5931-48a7-a126-abda7af7c51d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.164576 Nov 11 20:40:51.722892 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 310/552] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:51 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:51.774714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0316b979-a739-46ae-a50a-0399ae32784e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:51.775793 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0316b979-a739-46ae-a50a-0399ae32784e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:51.778321 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0ee10922-81e7-4dae-8fe2-18a57fa03d2b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:51.781558 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0316b979-a739-46ae-a50a-0399ae32784e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:51.785096 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0316b979-a739-46ae-a50a-0399ae32784e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:51.785566 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0ee10922-81e7-4dae-8fe2-18a57fa03d2b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1270 microversion: 2.1 time: 0.085785 Nov 11 20:40:51.786069 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0316b979-a739-46ae-a50a-0399ae32784e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:51.786762 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0316b979-a739-46ae-a50a-0399ae32784e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:51.786912 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 243/553] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:51 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:51.909620 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0316b979-a739-46ae-a50a-0399ae32784e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.138866 Nov 11 20:40:51.910170 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 311/554] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:51 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:40:52.031103 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2f3fe02a-60f6-416e-b7d3-138ecb6df264 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:52.031716 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2f3fe02a-60f6-416e-b7d3-138ecb6df264 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:52.038446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f3fe02a-60f6-416e-b7d3-138ecb6df264 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:52.039046 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f3fe02a-60f6-416e-b7d3-138ecb6df264 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:52.039838 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f3fe02a-60f6-416e-b7d3-138ecb6df264 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:52.040302 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f3fe02a-60f6-416e-b7d3-138ecb6df264 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:52.176502 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-2f3fe02a-60f6-416e-b7d3-138ecb6df264 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:52.184907 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2f3fe02a-60f6-416e-b7d3-138ecb6df264 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1499 microversion: 2.1 time: 0.157624 Nov 11 20:40:52.185699 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 244/555] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:52 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1499 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:52.741834 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0a8ef453-3ddc-4db3-aac5-15f2cdfdec2a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:52.742737 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0a8ef453-3ddc-4db3-aac5-15f2cdfdec2a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:52.750189 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0a8ef453-3ddc-4db3-aac5-15f2cdfdec2a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:52.750731 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0a8ef453-3ddc-4db3-aac5-15f2cdfdec2a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:52.751632 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0a8ef453-3ddc-4db3-aac5-15f2cdfdec2a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:52.752242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0a8ef453-3ddc-4db3-aac5-15f2cdfdec2a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:52.802801 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6aef6a60-c1fe-40e3-bdb7-29ca5b900065 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:52.804757 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6aef6a60-c1fe-40e3-bdb7-29ca5b900065 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:52.810964 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6aef6a60-c1fe-40e3-bdb7-29ca5b900065 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:52.811414 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6aef6a60-c1fe-40e3-bdb7-29ca5b900065 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:52.812221 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6aef6a60-c1fe-40e3-bdb7-29ca5b900065 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:52.812660 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6aef6a60-c1fe-40e3-bdb7-29ca5b900065 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:52.907158 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-6aef6a60-c1fe-40e3-bdb7-29ca5b900065 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:52.914681 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6aef6a60-c1fe-40e3-bdb7-29ca5b900065 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1276 microversion: 2.1 time: 0.115508 Nov 11 20:40:52.915523 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 245/556] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:52 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:52.920002 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-81d8dabc-d1df-4cc3-8ece-9ca753f15f3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:52.921013 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-81d8dabc-d1df-4cc3-8ece-9ca753f15f3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:52.927380 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-81d8dabc-d1df-4cc3-8ece-9ca753f15f3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:52.928013 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-81d8dabc-d1df-4cc3-8ece-9ca753f15f3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:52.928874 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-81d8dabc-d1df-4cc3-8ece-9ca753f15f3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:52.929637 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-81d8dabc-d1df-4cc3-8ece-9ca753f15f3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:53.008313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0a8ef453-3ddc-4db3-aac5-15f2cdfdec2a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:53.025215 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0a8ef453-3ddc-4db3-aac5-15f2cdfdec2a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.288567 Nov 11 20:40:53.025799 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 312/557] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:52 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:53.043591 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-81d8dabc-d1df-4cc3-8ece-9ca753f15f3f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.126804 Nov 11 20:40:53.047424 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 246/558] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:52 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:53.068740 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-44e7fa8b-8a0b-4542-8111-5eea2cf6fac3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:53.069999 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-44e7fa8b-8a0b-4542-8111-5eea2cf6fac3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:53.077582 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-44e7fa8b-8a0b-4542-8111-5eea2cf6fac3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:53.078034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-44e7fa8b-8a0b-4542-8111-5eea2cf6fac3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:53.078829 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-44e7fa8b-8a0b-4542-8111-5eea2cf6fac3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:53.079265 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-44e7fa8b-8a0b-4542-8111-5eea2cf6fac3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:53.109168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-44e7fa8b-8a0b-4542-8111-5eea2cf6fac3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Going to try to terminate instance {{(pid=122526) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:40:53.199758 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-44e7fa8b-8a0b-4542-8111-5eea2cf6fac3 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "DELETE /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 204 len: 0 microversion: 2.1 time: 0.132701 Nov 11 20:40:53.201338 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 313/559] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:40:53 2021] DELETE /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:40:53.210460 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f147a57b-8e98-4b17-9582-0bbb5b90738d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:53.211829 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f147a57b-8e98-4b17-9582-0bbb5b90738d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:53.218612 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f147a57b-8e98-4b17-9582-0bbb5b90738d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:53.219315 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f147a57b-8e98-4b17-9582-0bbb5b90738d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:53.220347 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f147a57b-8e98-4b17-9582-0bbb5b90738d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:53.220784 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f147a57b-8e98-4b17-9582-0bbb5b90738d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:53.503669 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f147a57b-8e98-4b17-9582-0bbb5b90738d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:53.513155 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f147a57b-8e98-4b17-9582-0bbb5b90738d tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1505 microversion: 2.1 time: 0.307263 Nov 11 20:40:53.513740 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 247/560] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:53 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:53.860051 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-060dcf92-cb49-4e10-b2b7-e8591221496e req-d93a5b27-f9b8-48d1-850b-2c2ff801f055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3faaf4a3-b047-49f0-b57f-b7ad4a9ca681", "tag": "4e0620dd-83bb-41b6-9d21-469aaf4c4d29"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:53.861538 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:53.861538 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:53.869521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-060dcf92-cb49-4e10-b2b7-e8591221496e req-d93a5b27-f9b8-48d1-850b-2c2ff801f055 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:53.870240 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-060dcf92-cb49-4e10-b2b7-e8591221496e req-d93a5b27-f9b8-48d1-850b-2c2ff801f055 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:53.882894 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-060dcf92-cb49-4e10-b2b7-e8591221496e req-d93a5b27-f9b8-48d1-850b-2c2ff801f055 service nova] Creating event network-changed:4e0620dd-83bb-41b6-9d21-469aaf4c4d29 for instance 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 on hv-cinder-81764 Nov 11 20:40:53.888553 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-060dcf92-cb49-4e10-b2b7-e8591221496e req-d93a5b27-f9b8-48d1-850b-2c2ff801f055 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032677 Nov 11 20:40:53.889157 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 314/561] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:53.933094 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4e306aab-1dde-47d7-87d3-b443b1da92de tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:53.933700 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4e306aab-1dde-47d7-87d3-b443b1da92de tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:53.940334 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4e306aab-1dde-47d7-87d3-b443b1da92de tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:53.940775 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4e306aab-1dde-47d7-87d3-b443b1da92de tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:53.941562 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4e306aab-1dde-47d7-87d3-b443b1da92de tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:53.942005 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4e306aab-1dde-47d7-87d3-b443b1da92de tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:54.043384 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f728ab4c-e519-4c46-948b-5eb84bc3061a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:54.044129 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f728ab4c-e519-4c46-948b-5eb84bc3061a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:54.057788 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f728ab4c-e519-4c46-948b-5eb84bc3061a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:54.058315 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f728ab4c-e519-4c46-948b-5eb84bc3061a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:54.059165 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f728ab4c-e519-4c46-948b-5eb84bc3061a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:54.059612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f728ab4c-e519-4c46-948b-5eb84bc3061a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:54.217680 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-4e306aab-1dde-47d7-87d3-b443b1da92de tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:54.224979 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4e306aab-1dde-47d7-87d3-b443b1da92de tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.295509 Nov 11 20:40:54.225616 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 248/562] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:53 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:54.229992 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ff272bdf-9f0e-4380-8282-2bc4832b0fdd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:54.230927 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ff272bdf-9f0e-4380-8282-2bc4832b0fdd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:54.236602 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ff272bdf-9f0e-4380-8282-2bc4832b0fdd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:54.237043 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ff272bdf-9f0e-4380-8282-2bc4832b0fdd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:54.237920 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ff272bdf-9f0e-4380-8282-2bc4832b0fdd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:54.238348 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ff272bdf-9f0e-4380-8282-2bc4832b0fdd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:54.318644 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f728ab4c-e519-4c46-948b-5eb84bc3061a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:54.326490 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f728ab4c-e519-4c46-948b-5eb84bc3061a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.287282 Nov 11 20:40:54.327061 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 315/563] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:54 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:54.393171 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ff272bdf-9f0e-4380-8282-2bc4832b0fdd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.166316 Nov 11 20:40:54.393835 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 249/564] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:54 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:54.531104 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-803488c4-9428-485f-b472-f49b463d36bd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:54.531705 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-803488c4-9428-485f-b472-f49b463d36bd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:54.538559 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-803488c4-9428-485f-b472-f49b463d36bd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:54.539000 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-803488c4-9428-485f-b472-f49b463d36bd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:54.539776 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-803488c4-9428-485f-b472-f49b463d36bd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:54.540231 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-803488c4-9428-485f-b472-f49b463d36bd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:54.729217 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-803488c4-9428-485f-b472-f49b463d36bd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:54.736441 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-803488c4-9428-485f-b472-f49b463d36bd tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1505 microversion: 2.1 time: 0.209321 Nov 11 20:40:54.737003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 316/565] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:54 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:55.241917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9740ca07-685f-4d25-973c-5f3dc9ee5b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:55.242824 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9740ca07-685f-4d25-973c-5f3dc9ee5b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:55.250063 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9740ca07-685f-4d25-973c-5f3dc9ee5b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:55.250505 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9740ca07-685f-4d25-973c-5f3dc9ee5b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:55.251276 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9740ca07-685f-4d25-973c-5f3dc9ee5b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:55.251704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9740ca07-685f-4d25-973c-5f3dc9ee5b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:55.304478 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-acfbe60c-a958-4ea1-aae1-6c83d49e2d27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:55.305188 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-acfbe60c-a958-4ea1-aae1-6c83d49e2d27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:55.310788 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-acfbe60c-a958-4ea1-aae1-6c83d49e2d27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:55.311229 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-acfbe60c-a958-4ea1-aae1-6c83d49e2d27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:55.312021 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-acfbe60c-a958-4ea1-aae1-6c83d49e2d27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:55.312451 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-acfbe60c-a958-4ea1-aae1-6c83d49e2d27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:55.336809 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-acfbe60c-a958-4ea1-aae1-6c83d49e2d27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lazy-loading 'flavor' on Instance uuid ce4a9f51-80d0-4901-beaf-9b03435f002c {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:40:55.387795 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9740ca07-685f-4d25-973c-5f3dc9ee5b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:55.395135 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9740ca07-685f-4d25-973c-5f3dc9ee5b35 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.157733 Nov 11 20:40:55.395722 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 250/566] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:55 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:55.401057 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-682f8e4c-19b9-45b3-8ba2-2cab02f31750 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:55.401678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-682f8e4c-19b9-45b3-8ba2-2cab02f31750 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:55.411530 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-682f8e4c-19b9-45b3-8ba2-2cab02f31750 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:55.412045 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-682f8e4c-19b9-45b3-8ba2-2cab02f31750 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:55.412949 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-682f8e4c-19b9-45b3-8ba2-2cab02f31750 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:55.413949 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-682f8e4c-19b9-45b3-8ba2-2cab02f31750 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:55.554482 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-682f8e4c-19b9-45b3-8ba2-2cab02f31750 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:55.563481 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-682f8e4c-19b9-45b3-8ba2-2cab02f31750 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.166529 Nov 11 20:40:55.564144 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 251/567] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:55 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:55.570134 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1098e9f1-c4ff-44ce-b8cf-86b3ee496aa0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:55.571256 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1098e9f1-c4ff-44ce-b8cf-86b3ee496aa0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:55.578023 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1098e9f1-c4ff-44ce-b8cf-86b3ee496aa0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:55.578760 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1098e9f1-c4ff-44ce-b8cf-86b3ee496aa0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:55.579572 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1098e9f1-c4ff-44ce-b8cf-86b3ee496aa0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:55.580064 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1098e9f1-c4ff-44ce-b8cf-86b3ee496aa0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:55.602304 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-acfbe60c-a958-4ea1-aae1-6c83d49e2d27 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 202 len: 0 microversion: 2.20 time: 0.301856 Nov 11 20:40:55.603076 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 317/568] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:40:55 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 11 20:40:55.611141 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f95ff4db-a866-41f3-b24e-44217ea72815 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:55.611858 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f95ff4db-a866-41f3-b24e-44217ea72815 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:55.618693 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f95ff4db-a866-41f3-b24e-44217ea72815 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:55.619133 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f95ff4db-a866-41f3-b24e-44217ea72815 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:55.619907 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f95ff4db-a866-41f3-b24e-44217ea72815 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:55.620377 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f95ff4db-a866-41f3-b24e-44217ea72815 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:55.747891 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1098e9f1-c4ff-44ce-b8cf-86b3ee496aa0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.182443 Nov 11 20:40:55.748545 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 252/569] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:55 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:55.754324 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a0a3f698-c9ac-4aae-9594-6bfca0204aa1 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:55.755007 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a0a3f698-c9ac-4aae-9594-6bfca0204aa1 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:55.759546 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f95ff4db-a866-41f3-b24e-44217ea72815 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:55.761914 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a0a3f698-c9ac-4aae-9594-6bfca0204aa1 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:55.762366 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a0a3f698-c9ac-4aae-9594-6bfca0204aa1 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:55.763145 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a0a3f698-c9ac-4aae-9594-6bfca0204aa1 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:55.763572 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a0a3f698-c9ac-4aae-9594-6bfca0204aa1 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:55.768116 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f95ff4db-a866-41f3-b24e-44217ea72815 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:55.769791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f95ff4db-a866-41f3-b24e-44217ea72815 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:55.770993 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f95ff4db-a866-41f3-b24e-44217ea72815 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.163713 Nov 11 20:40:55.771595 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 318/570] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:40:55 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:40:55.895710 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a0a3f698-c9ac-4aae-9594-6bfca0204aa1 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:55.903090 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a0a3f698-c9ac-4aae-9594-6bfca0204aa1 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1505 microversion: 2.1 time: 0.152541 Nov 11 20:40:55.903655 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 253/571] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:55 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:56.412426 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f48a8652-af75-4ffd-b5bf-8a8cafecb449 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:56.413030 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f48a8652-af75-4ffd-b5bf-8a8cafecb449 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:56.419518 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f48a8652-af75-4ffd-b5bf-8a8cafecb449 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:56.419996 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f48a8652-af75-4ffd-b5bf-8a8cafecb449 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:56.420775 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f48a8652-af75-4ffd-b5bf-8a8cafecb449 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:56.421209 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f48a8652-af75-4ffd-b5bf-8a8cafecb449 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:56.552706 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f48a8652-af75-4ffd-b5bf-8a8cafecb449 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:56.560659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f48a8652-af75-4ffd-b5bf-8a8cafecb449 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.151912 Nov 11 20:40:56.561258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 319/572] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:56 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:56.581352 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0336f336-7b7f-41c6-8113-3b339a16fbf9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:56.582044 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0336f336-7b7f-41c6-8113-3b339a16fbf9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:56.588413 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0336f336-7b7f-41c6-8113-3b339a16fbf9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:56.588864 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0336f336-7b7f-41c6-8113-3b339a16fbf9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:56.589638 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0336f336-7b7f-41c6-8113-3b339a16fbf9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:56.590184 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0336f336-7b7f-41c6-8113-3b339a16fbf9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:56.723259 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0336f336-7b7f-41c6-8113-3b339a16fbf9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:56.730599 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0336f336-7b7f-41c6-8113-3b339a16fbf9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.153192 Nov 11 20:40:56.731154 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 254/573] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:56 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:56.759535 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-43ee6012-cb00-46e1-8162-9888a308ebf8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:56.760536 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-43ee6012-cb00-46e1-8162-9888a308ebf8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:56.766395 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-43ee6012-cb00-46e1-8162-9888a308ebf8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:56.766833 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-43ee6012-cb00-46e1-8162-9888a308ebf8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:56.767604 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-43ee6012-cb00-46e1-8162-9888a308ebf8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:56.768059 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-43ee6012-cb00-46e1-8162-9888a308ebf8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:56.789873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-87a76906-e59f-494a-bdf7-2ddc0db5098b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:56.790424 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-87a76906-e59f-494a-bdf7-2ddc0db5098b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:56.796879 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-87a76906-e59f-494a-bdf7-2ddc0db5098b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:56.797337 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-87a76906-e59f-494a-bdf7-2ddc0db5098b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:56.798139 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-87a76906-e59f-494a-bdf7-2ddc0db5098b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:56.798604 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-87a76906-e59f-494a-bdf7-2ddc0db5098b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:56.928805 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-43ee6012-cb00-46e1-8162-9888a308ebf8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.173040 Nov 11 20:40:56.932108 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 320/574] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:56 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:40:56.934356 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-18f7937f-05e1-4de1-945a-e8748fb0ffb0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:56.935048 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-18f7937f-05e1-4de1-945a-e8748fb0ffb0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:56.938429 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-87a76906-e59f-494a-bdf7-2ddc0db5098b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:56.941885 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-18f7937f-05e1-4de1-945a-e8748fb0ffb0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:56.942331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-18f7937f-05e1-4de1-945a-e8748fb0ffb0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:56.943111 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-18f7937f-05e1-4de1-945a-e8748fb0ffb0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:56.943539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-18f7937f-05e1-4de1-945a-e8748fb0ffb0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:56.947197 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-87a76906-e59f-494a-bdf7-2ddc0db5098b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:56.948817 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-87a76906-e59f-494a-bdf7-2ddc0db5098b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:56.950034 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-87a76906-e59f-494a-bdf7-2ddc0db5098b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.164025 Nov 11 20:40:56.950672 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 255/575] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:40:56 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:40:57.077335 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-18f7937f-05e1-4de1-945a-e8748fb0ffb0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:57.085338 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-18f7937f-05e1-4de1-945a-e8748fb0ffb0 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1505 microversion: 2.1 time: 0.154179 Nov 11 20:40:57.085887 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 321/576] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:56 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:57.578590 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8d416e95-c22b-4d08-8363-fd428a06c8e8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:57.579189 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8d416e95-c22b-4d08-8363-fd428a06c8e8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:57.586078 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8d416e95-c22b-4d08-8363-fd428a06c8e8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:57.586660 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8d416e95-c22b-4d08-8363-fd428a06c8e8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:57.587267 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8d416e95-c22b-4d08-8363-fd428a06c8e8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:57.587700 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8d416e95-c22b-4d08-8363-fd428a06c8e8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:57.746545 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-505b003a-5c78-4e3a-8115-78e2d0b2d869 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:57.747173 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-505b003a-5c78-4e3a-8115-78e2d0b2d869 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:57.753699 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-505b003a-5c78-4e3a-8115-78e2d0b2d869 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:57.754148 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-505b003a-5c78-4e3a-8115-78e2d0b2d869 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:57.754921 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-505b003a-5c78-4e3a-8115-78e2d0b2d869 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:57.755351 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-505b003a-5c78-4e3a-8115-78e2d0b2d869 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:57.782805 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-8d416e95-c22b-4d08-8363-fd428a06c8e8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:57.794506 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8d416e95-c22b-4d08-8363-fd428a06c8e8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.219717 Nov 11 20:40:57.795090 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 256/577] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:57 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:57.939798 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-da1079b4-a439-46e3-9aa9-5e9d9f5f837f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:57.941085 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-da1079b4-a439-46e3-9aa9-5e9d9f5f837f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:57.947494 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-da1079b4-a439-46e3-9aa9-5e9d9f5f837f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:57.947938 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-da1079b4-a439-46e3-9aa9-5e9d9f5f837f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:57.948766 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-da1079b4-a439-46e3-9aa9-5e9d9f5f837f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:57.949208 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-da1079b4-a439-46e3-9aa9-5e9d9f5f837f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:57.980156 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-505b003a-5c78-4e3a-8115-78e2d0b2d869 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:57.987320 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-505b003a-5c78-4e3a-8115-78e2d0b2d869 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.244394 Nov 11 20:40:57.987884 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 322/578] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:57 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:57.992374 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-dfa2b7e5-41c5-45e6-b57d-606770d9741e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:57.993201 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-dfa2b7e5-41c5-45e6-b57d-606770d9741e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:58.000026 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dfa2b7e5-41c5-45e6-b57d-606770d9741e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:58.000590 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dfa2b7e5-41c5-45e6-b57d-606770d9741e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:58.001472 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dfa2b7e5-41c5-45e6-b57d-606770d9741e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:58.002003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dfa2b7e5-41c5-45e6-b57d-606770d9741e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:58.053841 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-da1079b4-a439-46e3-9aa9-5e9d9f5f837f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14 microversion: 2.1 time: 0.117358 Nov 11 20:40:58.057191 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 257/579] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:57 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:40:58.103029 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f4b46c47-c0f5-4d38-bfce-4158e53ef740 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:58.103721 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f4b46c47-c0f5-4d38-bfce-4158e53ef740 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:58.110636 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f4b46c47-c0f5-4d38-bfce-4158e53ef740 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:58.111082 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f4b46c47-c0f5-4d38-bfce-4158e53ef740 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:58.111861 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f4b46c47-c0f5-4d38-bfce-4158e53ef740 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:58.112331 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f4b46c47-c0f5-4d38-bfce-4158e53ef740 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:58.268657 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-dfa2b7e5-41c5-45e6-b57d-606770d9741e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:58.277579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-dfa2b7e5-41c5-45e6-b57d-606770d9741e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:58.279053 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-dfa2b7e5-41c5-45e6-b57d-606770d9741e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:58.280231 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-dfa2b7e5-41c5-45e6-b57d-606770d9741e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.291357 Nov 11 20:40:58.280785 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 323/580] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:40:57 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:40:58.388696 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f4b46c47-c0f5-4d38-bfce-4158e53ef740 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e9b275844d430db3a1826bb4306612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3138643605461997fb39e99bac9845', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:58.393232 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-548d3ece-9838-41f8-a4be-6087723f2d13 req-931b6305-45a3-45d0-9245-bcab51ac9dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138b8b00-39e4-462d-ae08-c582c980e976", "name": "network-vif-deleted", "tag": "aa053e0f-920f-42dd-bd56-f2d49a9c85f0"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:58.395729 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:40:58.395729 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:40:58.399748 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f4b46c47-c0f5-4d38-bfce-4158e53ef740 tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 200 len: 1505 microversion: 2.1 time: 0.300805 Nov 11 20:40:58.400381 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 258/581] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:58 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:40:58.403156 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-548d3ece-9838-41f8-a4be-6087723f2d13 req-931b6305-45a3-45d0-9245-bcab51ac9dc1 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:58.403592 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-548d3ece-9838-41f8-a4be-6087723f2d13 req-931b6305-45a3-45d0-9245-bcab51ac9dc1 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:58.415959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-548d3ece-9838-41f8-a4be-6087723f2d13 req-931b6305-45a3-45d0-9245-bcab51ac9dc1 service nova] Creating event network-vif-deleted:aa053e0f-920f-42dd-bd56-f2d49a9c85f0 for instance 138b8b00-39e4-462d-ae08-c582c980e976 on hv-cinder-81764 Nov 11 20:40:58.421202 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-548d3ece-9838-41f8-a4be-6087723f2d13 req-931b6305-45a3-45d0-9245-bcab51ac9dc1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037728 Nov 11 20:40:58.421807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 324/582] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:40:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:40:58.810858 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7da5a3f5-d9a7-4019-ba0e-dae52fcc9282 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:58.811387 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7da5a3f5-d9a7-4019-ba0e-dae52fcc9282 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:58.817846 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7da5a3f5-d9a7-4019-ba0e-dae52fcc9282 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:58.818296 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7da5a3f5-d9a7-4019-ba0e-dae52fcc9282 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:58.820155 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7da5a3f5-d9a7-4019-ba0e-dae52fcc9282 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:58.820600 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7da5a3f5-d9a7-4019-ba0e-dae52fcc9282 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:58.950442 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7da5a3f5-d9a7-4019-ba0e-dae52fcc9282 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:58.957798 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7da5a3f5-d9a7-4019-ba0e-dae52fcc9282 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.150788 Nov 11 20:40:58.958388 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 259/583] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:58 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:59.005282 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-90b1274e-c917-4742-bb69-d7ff86cd66b0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:59.005979 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-90b1274e-c917-4742-bb69-d7ff86cd66b0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:59.012762 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90b1274e-c917-4742-bb69-d7ff86cd66b0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:59.013215 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90b1274e-c917-4742-bb69-d7ff86cd66b0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:59.013994 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90b1274e-c917-4742-bb69-d7ff86cd66b0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:59.014434 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90b1274e-c917-4742-bb69-d7ff86cd66b0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:59.064702 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7e5c5c33-e455-4e67-ad51-1b50b5ffd2a6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:40:59.065537 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7e5c5c33-e455-4e67-ad51-1b50b5ffd2a6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:59.072255 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7e5c5c33-e455-4e67-ad51-1b50b5ffd2a6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:59.072698 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7e5c5c33-e455-4e67-ad51-1b50b5ffd2a6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:59.073472 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7e5c5c33-e455-4e67-ad51-1b50b5ffd2a6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:59.073904 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7e5c5c33-e455-4e67-ad51-1b50b5ffd2a6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:59.156713 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-90b1274e-c917-4742-bb69-d7ff86cd66b0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:59.164548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-90b1274e-c917-4742-bb69-d7ff86cd66b0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.163607 Nov 11 20:40:59.175148 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 325/584] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:58 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:40:59.254372 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7e5c5c33-e455-4e67-ad51-1b50b5ffd2a6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 575 microversion: 2.1 time: 0.193174 Nov 11 20:40:59.257794 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 260/585] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:40:59 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:40:59.298538 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b9345000-d498-44f4-a364-75f11ba50231 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:59.300704 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b9345000-d498-44f4-a364-75f11ba50231 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:59.311884 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b9345000-d498-44f4-a364-75f11ba50231 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:59.315317 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b9345000-d498-44f4-a364-75f11ba50231 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:59.316851 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b9345000-d498-44f4-a364-75f11ba50231 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:59.319392 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b9345000-d498-44f4-a364-75f11ba50231 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:59.416918 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6c553143-2638-4924-9554-7347c9a5407e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:59.417646 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6c553143-2638-4924-9554-7347c9a5407e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] [instance: 138b8b00-39e4-462d-ae08-c582c980e976] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:59.424554 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6c553143-2638-4924-9554-7347c9a5407e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:59.425005 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6c553143-2638-4924-9554-7347c9a5407e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:59.425790 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6c553143-2638-4924-9554-7347c9a5407e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:59.426222 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6c553143-2638-4924-9554-7347c9a5407e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:59.441093 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-6c553143-2638-4924-9554-7347c9a5407e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] HTTP exception thrown: Instance 138b8b00-39e4-462d-ae08-c582c980e976 could not be found. Nov 11 20:40:59.441701 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6c553143-2638-4924-9554-7347c9a5407e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] Returning 404 to user: Instance 138b8b00-39e4-462d-ae08-c582c980e976 could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:40:59.442536 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6c553143-2638-4924-9554-7347c9a5407e tempest-VolumesActionsTest-265683257 tempest-VolumesActionsTest-265683257-project] 10.222.0.61 "GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976" status: 404 len: 111 microversion: 2.1 time: 0.029999 Nov 11 20:40:59.443082 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 261/586] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:59 2021] GET /compute/v2.1/servers/138b8b00-39e4-462d-ae08-c582c980e976 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 11 20:40:59.468949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b9345000-d498-44f4-a364-75f11ba50231 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:59.476780 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b9345000-d498-44f4-a364-75f11ba50231 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:59.478272 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b9345000-d498-44f4-a364-75f11ba50231 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:40:59.479648 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b9345000-d498-44f4-a364-75f11ba50231 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.185027 Nov 11 20:40:59.480691 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 326/587] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:40:59 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:40:59.975313 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1b31a5f2-0613-4b2e-8363-217e46a5517a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:40:59.976026 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1b31a5f2-0613-4b2e-8363-217e46a5517a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:40:59.982139 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b31a5f2-0613-4b2e-8363-217e46a5517a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:59.982590 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b31a5f2-0613-4b2e-8363-217e46a5517a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:40:59.983398 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b31a5f2-0613-4b2e-8363-217e46a5517a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:40:59.983855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b31a5f2-0613-4b2e-8363-217e46a5517a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:00.127150 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-1b31a5f2-0613-4b2e-8363-217e46a5517a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:00.135500 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1b31a5f2-0613-4b2e-8363-217e46a5517a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.164092 Nov 11 20:41:00.136074 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 262/588] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:40:59 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:00.182879 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-77bb8e23-0ace-4b83-9380-00b157976753 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:00.183484 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-77bb8e23-0ace-4b83-9380-00b157976753 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:00.189757 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-77bb8e23-0ace-4b83-9380-00b157976753 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:00.190206 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-77bb8e23-0ace-4b83-9380-00b157976753 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:00.190982 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-77bb8e23-0ace-4b83-9380-00b157976753 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:00.191416 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-77bb8e23-0ace-4b83-9380-00b157976753 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:00.265585 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4c180dbd-e0c8-4a95-b86c-051f9db7a3f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:00.266504 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4c180dbd-e0c8-4a95-b86c-051f9db7a3f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:00.273142 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4c180dbd-e0c8-4a95-b86c-051f9db7a3f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:00.273597 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4c180dbd-e0c8-4a95-b86c-051f9db7a3f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:00.274387 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4c180dbd-e0c8-4a95-b86c-051f9db7a3f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:00.274823 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4c180dbd-e0c8-4a95-b86c-051f9db7a3f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:00.335443 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-77bb8e23-0ace-4b83-9380-00b157976753 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:00.343863 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-77bb8e23-0ace-4b83-9380-00b157976753 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.165694 Nov 11 20:41:00.344611 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 327/589] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:00 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:00.442364 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4c180dbd-e0c8-4a95-b86c-051f9db7a3f0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 6451 microversion: 2.1 time: 0.180263 Nov 11 20:41:00.443003 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 263/590] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:00 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 6451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:00.498548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-609d8851-3f83-405c-9737-b8d36f3ca435 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:00.499180 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-609d8851-3f83-405c-9737-b8d36f3ca435 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:00.505151 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-609d8851-3f83-405c-9737-b8d36f3ca435 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:00.505609 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-609d8851-3f83-405c-9737-b8d36f3ca435 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:00.506437 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-609d8851-3f83-405c-9737-b8d36f3ca435 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:00.507072 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-609d8851-3f83-405c-9737-b8d36f3ca435 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:00.635070 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-609d8851-3f83-405c-9737-b8d36f3ca435 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:00.642893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-609d8851-3f83-405c-9737-b8d36f3ca435 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:00.644436 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-609d8851-3f83-405c-9737-b8d36f3ca435 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:00.645616 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-609d8851-3f83-405c-9737-b8d36f3ca435 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.150846 Nov 11 20:41:00.646186 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 328/591] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:00 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:01.153435 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6c3a9810-f10e-42db-ac07-297b1e1f56af tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:01.154130 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6c3a9810-f10e-42db-ac07-297b1e1f56af tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:01.161123 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6c3a9810-f10e-42db-ac07-297b1e1f56af tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:01.161578 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6c3a9810-f10e-42db-ac07-297b1e1f56af tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:01.162365 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6c3a9810-f10e-42db-ac07-297b1e1f56af tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:01.162824 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6c3a9810-f10e-42db-ac07-297b1e1f56af tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:01.297148 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-6c3a9810-f10e-42db-ac07-297b1e1f56af tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:01.305475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6c3a9810-f10e-42db-ac07-297b1e1f56af tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.156135 Nov 11 20:41:01.306039 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 264/592] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:01 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:01.361411 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cc603dab-c6d9-48fd-bd96-94f7733e8745 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:01.362041 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cc603dab-c6d9-48fd-bd96-94f7733e8745 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:01.369301 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cc603dab-c6d9-48fd-bd96-94f7733e8745 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:01.369747 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cc603dab-c6d9-48fd-bd96-94f7733e8745 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:01.370527 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cc603dab-c6d9-48fd-bd96-94f7733e8745 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:01.370961 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cc603dab-c6d9-48fd-bd96-94f7733e8745 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:01.453775 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f8887ff7-c29d-4bed-a9fd-a9e039e0f3a7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:01.454700 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f8887ff7-c29d-4bed-a9fd-a9e039e0f3a7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:01.461877 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f8887ff7-c29d-4bed-a9fd-a9e039e0f3a7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:01.462503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f8887ff7-c29d-4bed-a9fd-a9e039e0f3a7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:01.463289 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f8887ff7-c29d-4bed-a9fd-a9e039e0f3a7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:01.463771 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f8887ff7-c29d-4bed-a9fd-a9e039e0f3a7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:01.505926 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cc603dab-c6d9-48fd-bd96-94f7733e8745 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:01.514301 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cc603dab-c6d9-48fd-bd96-94f7733e8745 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.156609 Nov 11 20:41:01.514865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 329/593] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:01 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:01.667257 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4616f382-4ea7-4105-a66a-38fa35e3f9fa tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:01.668346 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4616f382-4ea7-4105-a66a-38fa35e3f9fa tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:01.674410 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4616f382-4ea7-4105-a66a-38fa35e3f9fa tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:01.674854 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4616f382-4ea7-4105-a66a-38fa35e3f9fa tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:01.675759 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4616f382-4ea7-4105-a66a-38fa35e3f9fa tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:01.676214 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4616f382-4ea7-4105-a66a-38fa35e3f9fa tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:01.806558 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4616f382-4ea7-4105-a66a-38fa35e3f9fa tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:01.814188 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4616f382-4ea7-4105-a66a-38fa35e3f9fa tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:01.815676 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4616f382-4ea7-4105-a66a-38fa35e3f9fa tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:01.816876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4616f382-4ea7-4105-a66a-38fa35e3f9fa tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.154014 Nov 11 20:41:01.817449 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 330/594] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:01 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:02.322840 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7bd7f523-7c92-4122-8753-e81e514e3aaf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:02.323479 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7bd7f523-7c92-4122-8753-e81e514e3aaf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:02.329664 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7bd7f523-7c92-4122-8753-e81e514e3aaf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:02.330114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7bd7f523-7c92-4122-8753-e81e514e3aaf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:02.330890 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7bd7f523-7c92-4122-8753-e81e514e3aaf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:02.331354 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7bd7f523-7c92-4122-8753-e81e514e3aaf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:02.702184 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7bd7f523-7c92-4122-8753-e81e514e3aaf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:02.710453 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7bd7f523-7c92-4122-8753-e81e514e3aaf tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.391499 Nov 11 20:41:02.711025 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 331/595] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:02 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:02.715429 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7d9902e7-3818-4a44-a344-a6b3998238d5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:02.716063 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7d9902e7-3818-4a44-a344-a6b3998238d5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:02.721493 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7d9902e7-3818-4a44-a344-a6b3998238d5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:02.721939 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7d9902e7-3818-4a44-a344-a6b3998238d5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:02.722708 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7d9902e7-3818-4a44-a344-a6b3998238d5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:02.723164 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7d9902e7-3818-4a44-a344-a6b3998238d5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:02.852278 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7d9902e7-3818-4a44-a344-a6b3998238d5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:02.859892 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7d9902e7-3818-4a44-a344-a6b3998238d5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.147769 Nov 11 20:41:02.860537 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 332/596] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:02 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:02.865032 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-db191a4c-8fae-4945-8d6a-ab6b4c457c79 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:02.865633 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-db191a4c-8fae-4945-8d6a-ab6b4c457c79 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:02.872341 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-db191a4c-8fae-4945-8d6a-ab6b4c457c79 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:02.872787 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-db191a4c-8fae-4945-8d6a-ab6b4c457c79 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:02.873607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-db191a4c-8fae-4945-8d6a-ab6b4c457c79 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:02.874041 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-db191a4c-8fae-4945-8d6a-ab6b4c457c79 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:03.009334 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-db191a4c-8fae-4945-8d6a-ab6b4c457c79 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:03.017276 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-db191a4c-8fae-4945-8d6a-ab6b4c457c79 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:03.018753 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-db191a4c-8fae-4945-8d6a-ab6b4c457c79 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:03.019895 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-db191a4c-8fae-4945-8d6a-ab6b4c457c79 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.158422 Nov 11 20:41:03.020478 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 333/597] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:02 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:03.727136 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1c224439-314c-4dc2-a091-08eb590b196b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:03.727801 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1c224439-314c-4dc2-a091-08eb590b196b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:03.733989 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1c224439-314c-4dc2-a091-08eb590b196b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:03.734433 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1c224439-314c-4dc2-a091-08eb590b196b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:03.735195 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1c224439-314c-4dc2-a091-08eb590b196b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:03.735623 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1c224439-314c-4dc2-a091-08eb590b196b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:03.864772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1c224439-314c-4dc2-a091-08eb590b196b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:03.872696 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1c224439-314c-4dc2-a091-08eb590b196b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.149262 Nov 11 20:41:03.873267 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 334/598] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:03 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:03.878184 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-46b5f5a9-f32d-4519-818b-8a64ad49f385 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:03.878772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-46b5f5a9-f32d-4519-818b-8a64ad49f385 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:03.885131 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-46b5f5a9-f32d-4519-818b-8a64ad49f385 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:03.885578 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-46b5f5a9-f32d-4519-818b-8a64ad49f385 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:03.886391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-46b5f5a9-f32d-4519-818b-8a64ad49f385 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:03.886824 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-46b5f5a9-f32d-4519-818b-8a64ad49f385 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:04.019553 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-46b5f5a9-f32d-4519-818b-8a64ad49f385 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:04.027074 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-46b5f5a9-f32d-4519-818b-8a64ad49f385 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.152827 Nov 11 20:41:04.027647 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 335/599] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:03 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:04.038823 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f3bbb2ee-ecfe-4836-b161-56e4ffa2c4e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:04.039564 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f3bbb2ee-ecfe-4836-b161-56e4ffa2c4e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:04.045460 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f3bbb2ee-ecfe-4836-b161-56e4ffa2c4e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:04.045904 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f3bbb2ee-ecfe-4836-b161-56e4ffa2c4e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:04.046674 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f3bbb2ee-ecfe-4836-b161-56e4ffa2c4e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:04.047120 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f3bbb2ee-ecfe-4836-b161-56e4ffa2c4e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:04.179201 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f3bbb2ee-ecfe-4836-b161-56e4ffa2c4e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:04.187368 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f3bbb2ee-ecfe-4836-b161-56e4ffa2c4e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:04.188905 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f3bbb2ee-ecfe-4836-b161-56e4ffa2c4e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:04.190176 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f3bbb2ee-ecfe-4836-b161-56e4ffa2c4e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.155617 Nov 11 20:41:04.190804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 336/600] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:04 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:04.890403 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2aa4414a-064a-44d3-8328-5aa83db26561 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:04.891074 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2aa4414a-064a-44d3-8328-5aa83db26561 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:04.898387 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2aa4414a-064a-44d3-8328-5aa83db26561 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:04.898843 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2aa4414a-064a-44d3-8328-5aa83db26561 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:04.899679 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2aa4414a-064a-44d3-8328-5aa83db26561 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:04.900150 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2aa4414a-064a-44d3-8328-5aa83db26561 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:04.955701 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f8887ff7-c29d-4bed-a9fd-a9e039e0f3a7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 14391 microversion: 2.1 time: 3.505834 Nov 11 20:41:04.957219 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 265/601] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:01 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 14391 bytes in 3508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:41:05.031032 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2aa4414a-064a-44d3-8328-5aa83db26561 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:05.038399 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2aa4414a-064a-44d3-8328-5aa83db26561 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.151839 Nov 11 20:41:05.038959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 337/602] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:04 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:05.044664 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-cb78cb9b-1121-49ab-87f0-564461152bac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:05.045431 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-cb78cb9b-1121-49ab-87f0-564461152bac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:05.052106 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cb78cb9b-1121-49ab-87f0-564461152bac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:05.052554 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cb78cb9b-1121-49ab-87f0-564461152bac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:05.054025 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cb78cb9b-1121-49ab-87f0-564461152bac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:05.054025 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cb78cb9b-1121-49ab-87f0-564461152bac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:05.190211 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cb78cb9b-1121-49ab-87f0-564461152bac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:05.198904 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-cb78cb9b-1121-49ab-87f0-564461152bac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.158101 Nov 11 20:41:05.199474 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 266/603] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:05 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:05.208339 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1f1aee19-2b07-4c7d-a36e-43af12c472c1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:05.209049 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1f1aee19-2b07-4c7d-a36e-43af12c472c1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:05.214914 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1f1aee19-2b07-4c7d-a36e-43af12c472c1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:05.215364 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1f1aee19-2b07-4c7d-a36e-43af12c472c1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:05.216173 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1f1aee19-2b07-4c7d-a36e-43af12c472c1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:05.216643 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1f1aee19-2b07-4c7d-a36e-43af12c472c1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:05.347242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1f1aee19-2b07-4c7d-a36e-43af12c472c1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:05.355306 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1f1aee19-2b07-4c7d-a36e-43af12c472c1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:05.356829 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1f1aee19-2b07-4c7d-a36e-43af12c472c1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:05.357967 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1f1aee19-2b07-4c7d-a36e-43af12c472c1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.153382 Nov 11 20:41:05.358521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 338/604] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:05 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:05.966745 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f86d7883-70a8-433d-a635-c6715b82ae56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:05.967639 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f86d7883-70a8-433d-a635-c6715b82ae56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:05.973933 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f86d7883-70a8-433d-a635-c6715b82ae56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:05.974372 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f86d7883-70a8-433d-a635-c6715b82ae56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:05.975870 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f86d7883-70a8-433d-a635-c6715b82ae56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:05.976345 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f86d7883-70a8-433d-a635-c6715b82ae56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:06.054543 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-91446dd4-9bb0-4e61-ae25-1806bd28e515 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:06.055194 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-91446dd4-9bb0-4e61-ae25-1806bd28e515 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:06.061596 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-91446dd4-9bb0-4e61-ae25-1806bd28e515 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:06.062038 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-91446dd4-9bb0-4e61-ae25-1806bd28e515 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:06.062841 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-91446dd4-9bb0-4e61-ae25-1806bd28e515 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:06.063347 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-91446dd4-9bb0-4e61-ae25-1806bd28e515 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:06.151278 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f86d7883-70a8-433d-a635-c6715b82ae56 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 15064 microversion: 2.1 time: 0.188059 Nov 11 20:41:06.151926 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 267/605] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:05 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 15064 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:06.198410 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-91446dd4-9bb0-4e61-ae25-1806bd28e515 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:06.205752 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-91446dd4-9bb0-4e61-ae25-1806bd28e515 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.154980 Nov 11 20:41:06.206309 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 339/606] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:06 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:06.217177 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-91b293a0-7060-4d10-86aa-f2f154841839 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:06.217798 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-91b293a0-7060-4d10-86aa-f2f154841839 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:06.224569 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-91b293a0-7060-4d10-86aa-f2f154841839 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:06.225017 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-91b293a0-7060-4d10-86aa-f2f154841839 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:06.226229 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-91b293a0-7060-4d10-86aa-f2f154841839 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:06.226671 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-91b293a0-7060-4d10-86aa-f2f154841839 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:06.374526 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-91b293a0-7060-4d10-86aa-f2f154841839 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:06.377170 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-90c2cb1e-80b7-4bf3-9d33-6267652fd798 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:06.378103 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-90c2cb1e-80b7-4bf3-9d33-6267652fd798 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:06.383540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-91b293a0-7060-4d10-86aa-f2f154841839 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.170401 Nov 11 20:41:06.384148 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 268/607] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:06 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:06.385672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90c2cb1e-80b7-4bf3-9d33-6267652fd798 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:06.386151 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90c2cb1e-80b7-4bf3-9d33-6267652fd798 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:06.386951 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90c2cb1e-80b7-4bf3-9d33-6267652fd798 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:06.387382 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90c2cb1e-80b7-4bf3-9d33-6267652fd798 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:06.516633 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-90c2cb1e-80b7-4bf3-9d33-6267652fd798 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:06.525135 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-90c2cb1e-80b7-4bf3-9d33-6267652fd798 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:06.526755 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-90c2cb1e-80b7-4bf3-9d33-6267652fd798 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:06.528155 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-90c2cb1e-80b7-4bf3-9d33-6267652fd798 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.154786 Nov 11 20:41:06.528939 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 340/608] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:06 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:07.162238 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-eb864ce7-4bdf-41e5-8a2b-728cd31603e2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:07.163829 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-eb864ce7-4bdf-41e5-8a2b-728cd31603e2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:07.170102 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eb864ce7-4bdf-41e5-8a2b-728cd31603e2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:07.170544 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eb864ce7-4bdf-41e5-8a2b-728cd31603e2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:07.171326 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eb864ce7-4bdf-41e5-8a2b-728cd31603e2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:07.171826 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eb864ce7-4bdf-41e5-8a2b-728cd31603e2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:07.224984 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a0fe39ce-5195-46cc-b2e2-845737c67273 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:07.226356 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a0fe39ce-5195-46cc-b2e2-845737c67273 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:07.233213 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a0fe39ce-5195-46cc-b2e2-845737c67273 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:07.233709 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a0fe39ce-5195-46cc-b2e2-845737c67273 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:07.234620 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a0fe39ce-5195-46cc-b2e2-845737c67273 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:07.235054 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a0fe39ce-5195-46cc-b2e2-845737c67273 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:07.340105 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-eb864ce7-4bdf-41e5-8a2b-728cd31603e2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 17301 microversion: 2.1 time: 0.181170 Nov 11 20:41:07.341654 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 269/609] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:07 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 17301 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:07.379332 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a0fe39ce-5195-46cc-b2e2-845737c67273 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:07.386440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a0fe39ce-5195-46cc-b2e2-845737c67273 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.166064 Nov 11 20:41:07.387003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 341/610] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:07 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:07.401196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0822af9b-2b95-46cd-ac57-1771c189e832 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:07.401893 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0822af9b-2b95-46cd-ac57-1771c189e832 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:07.408760 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0822af9b-2b95-46cd-ac57-1771c189e832 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:07.409203 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0822af9b-2b95-46cd-ac57-1771c189e832 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:07.409987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0822af9b-2b95-46cd-ac57-1771c189e832 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:07.410419 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0822af9b-2b95-46cd-ac57-1771c189e832 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:07.548034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2ce95fa7-e42e-4618-b0db-919990a80dbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:07.548580 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2ce95fa7-e42e-4618-b0db-919990a80dbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:07.562270 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2ce95fa7-e42e-4618-b0db-919990a80dbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:07.563146 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2ce95fa7-e42e-4618-b0db-919990a80dbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:07.563871 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2ce95fa7-e42e-4618-b0db-919990a80dbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:07.564532 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2ce95fa7-e42e-4618-b0db-919990a80dbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:07.577588 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0822af9b-2b95-46cd-ac57-1771c189e832 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:07.586475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0822af9b-2b95-46cd-ac57-1771c189e832 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.190112 Nov 11 20:41:07.587045 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 270/611] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:07 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:07.651634 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-e7b4f730-3ea8-4e3f-82c5-5cff3d0f9063 req-a16e7df7-5c9a-4c66-9230-b0b34a7829c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3faaf4a3-b047-49f0-b57f-b7ad4a9ca681", "name": "network-vif-plugged", "status": "completed", "tag": "4e0620dd-83bb-41b6-9d21-469aaf4c4d29"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:07.653259 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:41:07.653259 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:41:07.662489 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-e7b4f730-3ea8-4e3f-82c5-5cff3d0f9063 req-a16e7df7-5c9a-4c66-9230-b0b34a7829c1 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:07.663610 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-e7b4f730-3ea8-4e3f-82c5-5cff3d0f9063 req-a16e7df7-5c9a-4c66-9230-b0b34a7829c1 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:07.675111 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-e7b4f730-3ea8-4e3f-82c5-5cff3d0f9063 req-a16e7df7-5c9a-4c66-9230-b0b34a7829c1 service nova] Creating event network-vif-plugged:4e0620dd-83bb-41b6-9d21-469aaf4c4d29 for instance 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 on hv-cinder-81764 Nov 11 20:41:07.695924 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-e7b4f730-3ea8-4e3f-82c5-5cff3d0f9063 req-a16e7df7-5c9a-4c66-9230-b0b34a7829c1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048095 Nov 11 20:41:07.697931 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 271/612] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:41:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:41:07.762173 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2ce95fa7-e42e-4618-b0db-919990a80dbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:07.770258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2ce95fa7-e42e-4618-b0db-919990a80dbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:07.771766 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2ce95fa7-e42e-4618-b0db-919990a80dbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:07.773856 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2ce95fa7-e42e-4618-b0db-919990a80dbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.230958 Nov 11 20:41:07.774423 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 342/613] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:07 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:08.351999 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6790b3eb-9ac8-4f90-b879-bcb6722af873 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:08.353710 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6790b3eb-9ac8-4f90-b879-bcb6722af873 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:08.359912 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6790b3eb-9ac8-4f90-b879-bcb6722af873 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:08.360404 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6790b3eb-9ac8-4f90-b879-bcb6722af873 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:08.361193 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6790b3eb-9ac8-4f90-b879-bcb6722af873 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:08.361630 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6790b3eb-9ac8-4f90-b879-bcb6722af873 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:08.403921 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7452323e-a3be-4968-8e49-8966d18e592d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:08.404550 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7452323e-a3be-4968-8e49-8966d18e592d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:08.410774 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7452323e-a3be-4968-8e49-8966d18e592d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:08.411221 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7452323e-a3be-4968-8e49-8966d18e592d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:08.412018 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7452323e-a3be-4968-8e49-8966d18e592d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:08.412452 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7452323e-a3be-4968-8e49-8966d18e592d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:08.532773 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6790b3eb-9ac8-4f90-b879-bcb6722af873 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 17602 microversion: 2.1 time: 0.185085 Nov 11 20:41:08.533622 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 272/614] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:08 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 17602 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:08.551784 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7452323e-a3be-4968-8e49-8966d18e592d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:08.559814 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7452323e-a3be-4968-8e49-8966d18e592d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.159784 Nov 11 20:41:08.560492 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 343/615] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:08 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:08.603106 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-eea2bee5-1591-4663-b268-4f5c108ef01d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:08.603718 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-eea2bee5-1591-4663-b268-4f5c108ef01d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:08.611316 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eea2bee5-1591-4663-b268-4f5c108ef01d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:08.611757 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eea2bee5-1591-4663-b268-4f5c108ef01d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:08.612574 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eea2bee5-1591-4663-b268-4f5c108ef01d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:08.613004 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eea2bee5-1591-4663-b268-4f5c108ef01d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:08.794044 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e915ec98-0084-4a45-8a76-b650e13db234 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:08.795314 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e915ec98-0084-4a45-8a76-b650e13db234 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:08.807173 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-eea2bee5-1591-4663-b268-4f5c108ef01d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:08.808405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e915ec98-0084-4a45-8a76-b650e13db234 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:08.809889 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e915ec98-0084-4a45-8a76-b650e13db234 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:08.810916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e915ec98-0084-4a45-8a76-b650e13db234 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:08.811546 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e915ec98-0084-4a45-8a76-b650e13db234 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:08.814763 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-eea2bee5-1591-4663-b268-4f5c108ef01d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.215829 Nov 11 20:41:08.815328 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 273/616] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:08 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:08.957664 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e915ec98-0084-4a45-8a76-b650e13db234 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:08.966077 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e915ec98-0084-4a45-8a76-b650e13db234 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:08.967579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e915ec98-0084-4a45-8a76-b650e13db234 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:08.968764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e915ec98-0084-4a45-8a76-b650e13db234 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.179569 Nov 11 20:41:08.969321 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 344/617] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:08 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:09.545031 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-992ea7b4-54fd-4b51-a978-2837a51d96de tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:09.545880 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-992ea7b4-54fd-4b51-a978-2837a51d96de tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:09.552265 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-992ea7b4-54fd-4b51-a978-2837a51d96de tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:09.552711 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-992ea7b4-54fd-4b51-a978-2837a51d96de tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:09.553542 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-992ea7b4-54fd-4b51-a978-2837a51d96de tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:09.553985 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-992ea7b4-54fd-4b51-a978-2837a51d96de tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:09.576974 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-38fb6a85-152e-43dc-81d2-c93756b5427c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:09.577528 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-38fb6a85-152e-43dc-81d2-c93756b5427c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:09.584422 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-38fb6a85-152e-43dc-81d2-c93756b5427c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:09.585357 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-38fb6a85-152e-43dc-81d2-c93756b5427c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:09.586181 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-38fb6a85-152e-43dc-81d2-c93756b5427c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:09.586811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-38fb6a85-152e-43dc-81d2-c93756b5427c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:09.679488 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-992ea7b4-54fd-4b51-a978-2837a51d96de tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 17602 microversion: 2.1 time: 0.137842 Nov 11 20:41:09.680429 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 274/618] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:09 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 17602 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:09.728467 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-38fb6a85-152e-43dc-81d2-c93756b5427c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:09.735630 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-38fb6a85-152e-43dc-81d2-c93756b5427c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.162464 Nov 11 20:41:09.736235 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 345/619] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:09 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:09.833866 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8cdfa0ad-e8df-41c1-ac4e-e58cc1534904 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:09.834704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8cdfa0ad-e8df-41c1-ac4e-e58cc1534904 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:09.842216 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8cdfa0ad-e8df-41c1-ac4e-e58cc1534904 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:09.842685 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8cdfa0ad-e8df-41c1-ac4e-e58cc1534904 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:09.843766 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8cdfa0ad-e8df-41c1-ac4e-e58cc1534904 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:09.844303 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8cdfa0ad-e8df-41c1-ac4e-e58cc1534904 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:09.984924 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-8cdfa0ad-e8df-41c1-ac4e-e58cc1534904 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:09.986865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c4557f14-5094-4d2a-8ea6-37866df5b1bc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:09.987729 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c4557f14-5094-4d2a-8ea6-37866df5b1bc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:09.993720 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8cdfa0ad-e8df-41c1-ac4e-e58cc1534904 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.163818 Nov 11 20:41:09.994924 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 275/620] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:09 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:09.996320 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c4557f14-5094-4d2a-8ea6-37866df5b1bc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:09.996761 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c4557f14-5094-4d2a-8ea6-37866df5b1bc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:10.000315 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c4557f14-5094-4d2a-8ea6-37866df5b1bc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:10.000725 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c4557f14-5094-4d2a-8ea6-37866df5b1bc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:10.136576 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c4557f14-5094-4d2a-8ea6-37866df5b1bc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:10.144300 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c4557f14-5094-4d2a-8ea6-37866df5b1bc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:10.145813 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c4557f14-5094-4d2a-8ea6-37866df5b1bc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:10.146945 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c4557f14-5094-4d2a-8ea6-37866df5b1bc tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.164283 Nov 11 20:41:10.148372 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 346/621] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:09 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:10.691120 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7e2dbb46-0185-440e-97c6-b4a10a223ae1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:10.692073 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7e2dbb46-0185-440e-97c6-b4a10a223ae1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:10.699260 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7e2dbb46-0185-440e-97c6-b4a10a223ae1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:10.699627 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7e2dbb46-0185-440e-97c6-b4a10a223ae1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:10.700459 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7e2dbb46-0185-440e-97c6-b4a10a223ae1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:10.700875 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7e2dbb46-0185-440e-97c6-b4a10a223ae1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:10.751723 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ae6956f4-df2a-4321-9d4e-a539dcba66bd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:10.752365 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ae6956f4-df2a-4321-9d4e-a539dcba66bd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:10.759462 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ae6956f4-df2a-4321-9d4e-a539dcba66bd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:10.759909 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ae6956f4-df2a-4321-9d4e-a539dcba66bd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:10.760715 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ae6956f4-df2a-4321-9d4e-a539dcba66bd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:10.761167 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ae6956f4-df2a-4321-9d4e-a539dcba66bd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:10.896256 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ae6956f4-df2a-4321-9d4e-a539dcba66bd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:10.904551 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ae6956f4-df2a-4321-9d4e-a539dcba66bd tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1318 microversion: 2.1 time: 0.156354 Nov 11 20:41:10.912526 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 347/622] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:10 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:10.979964 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7e2dbb46-0185-440e-97c6-b4a10a223ae1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 17861 microversion: 2.1 time: 0.292202 Nov 11 20:41:10.980557 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 276/623] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:10 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 17861 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:11.011569 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-da95a0b0-0c1e-4b26-a367-6e2d2913ecff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:11.012385 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-da95a0b0-0c1e-4b26-a367-6e2d2913ecff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:11.018606 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-da95a0b0-0c1e-4b26-a367-6e2d2913ecff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:11.019062 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-da95a0b0-0c1e-4b26-a367-6e2d2913ecff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:11.019858 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-da95a0b0-0c1e-4b26-a367-6e2d2913ecff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:11.020321 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-da95a0b0-0c1e-4b26-a367-6e2d2913ecff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:11.157848 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-da95a0b0-0c1e-4b26-a367-6e2d2913ecff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:11.166594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-da95a0b0-0c1e-4b26-a367-6e2d2913ecff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.159062 Nov 11 20:41:11.167500 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 348/624] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:11 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:11.167620 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-06520937-7d0b-4164-a16c-e79abe0fbb5d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:11.168077 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-06520937-7d0b-4164-a16c-e79abe0fbb5d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:11.175989 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-06520937-7d0b-4164-a16c-e79abe0fbb5d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:11.176446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-06520937-7d0b-4164-a16c-e79abe0fbb5d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:11.177227 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-06520937-7d0b-4164-a16c-e79abe0fbb5d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:11.177654 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-06520937-7d0b-4164-a16c-e79abe0fbb5d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:11.322326 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-06520937-7d0b-4164-a16c-e79abe0fbb5d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:11.330492 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-06520937-7d0b-4164-a16c-e79abe0fbb5d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:11.332004 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-06520937-7d0b-4164-a16c-e79abe0fbb5d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:11.333146 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-06520937-7d0b-4164-a16c-e79abe0fbb5d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.169916 Nov 11 20:41:11.333698 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 277/625] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:11 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:11.921281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5d44b59c-b739-4707-a52d-57486472d4db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:11.922058 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5d44b59c-b739-4707-a52d-57486472d4db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:11.928921 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5d44b59c-b739-4707-a52d-57486472d4db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:11.929359 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5d44b59c-b739-4707-a52d-57486472d4db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:11.930254 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5d44b59c-b739-4707-a52d-57486472d4db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:11.930787 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5d44b59c-b739-4707-a52d-57486472d4db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:11.990539 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0a238b14-86f3-4f44-b79d-d2d758dd1ef2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:11.994588 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0a238b14-86f3-4f44-b79d-d2d758dd1ef2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:12.003651 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a238b14-86f3-4f44-b79d-d2d758dd1ef2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:12.004140 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a238b14-86f3-4f44-b79d-d2d758dd1ef2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:12.004927 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a238b14-86f3-4f44-b79d-d2d758dd1ef2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:12.005358 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a238b14-86f3-4f44-b79d-d2d758dd1ef2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:12.079394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5d44b59c-b739-4707-a52d-57486472d4db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:12.088766 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5d44b59c-b739-4707-a52d-57486472d4db tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1507 microversion: 2.1 time: 0.170887 Nov 11 20:41:12.094256 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 349/626] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:11 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:12.162803 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0a238b14-86f3-4f44-b79d-d2d758dd1ef2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 18827 microversion: 2.1 time: 0.175613 Nov 11 20:41:12.163487 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 278/627] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:11 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 18827 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:41:12.185363 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-151efc36-2f6a-4379-9107-11d848ad7311 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:12.186133 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-151efc36-2f6a-4379-9107-11d848ad7311 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:12.194484 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-151efc36-2f6a-4379-9107-11d848ad7311 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:12.194748 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-151efc36-2f6a-4379-9107-11d848ad7311 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:12.195574 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-151efc36-2f6a-4379-9107-11d848ad7311 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:12.196205 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-151efc36-2f6a-4379-9107-11d848ad7311 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:12.349806 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-151efc36-2f6a-4379-9107-11d848ad7311 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:12.358729 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-98669220-9ade-4f7c-8506-831a88b2813f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:12.359451 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-98669220-9ade-4f7c-8506-831a88b2813f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:12.360752 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-151efc36-2f6a-4379-9107-11d848ad7311 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.180509 Nov 11 20:41:12.371524 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 350/628] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:12 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:12.374909 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-98669220-9ade-4f7c-8506-831a88b2813f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:12.375405 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-98669220-9ade-4f7c-8506-831a88b2813f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:12.376463 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-98669220-9ade-4f7c-8506-831a88b2813f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:12.376694 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-98669220-9ade-4f7c-8506-831a88b2813f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:12.532611 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-98669220-9ade-4f7c-8506-831a88b2813f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:12.541112 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-98669220-9ade-4f7c-8506-831a88b2813f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:12.542815 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-98669220-9ade-4f7c-8506-831a88b2813f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:12.543989 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-98669220-9ade-4f7c-8506-831a88b2813f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.196953 Nov 11 20:41:12.544726 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 279/629] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:12 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:13.174426 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5626729f-0451-42b9-9307-43037a0f8935 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:13.175404 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5626729f-0451-42b9-9307-43037a0f8935 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:13.182880 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5626729f-0451-42b9-9307-43037a0f8935 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.183342 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5626729f-0451-42b9-9307-43037a0f8935 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.184140 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5626729f-0451-42b9-9307-43037a0f8935 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.184575 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5626729f-0451-42b9-9307-43037a0f8935 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.337069 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5626729f-0451-42b9-9307-43037a0f8935 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 18871 microversion: 2.1 time: 0.166059 Nov 11 20:41:13.337988 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 351/630] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:13 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 18871 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:13.377500 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f3733b8e-dc05-44f6-ae5f-451badc626ac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:13.378101 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f3733b8e-dc05-44f6-ae5f-451badc626ac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:13.384502 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f3733b8e-dc05-44f6-ae5f-451badc626ac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.384952 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f3733b8e-dc05-44f6-ae5f-451badc626ac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.385706 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f3733b8e-dc05-44f6-ae5f-451badc626ac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.386126 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f3733b8e-dc05-44f6-ae5f-451badc626ac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.465688 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c4506aa8-5b37-443b-963c-9b29973750a2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1ef5cc3-eb92-46d5-91d9-e4180db90910"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:13.467088 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c4506aa8-5b37-443b-963c-9b29973750a2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:13.486300 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c4506aa8-5b37-443b-963c-9b29973750a2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.486798 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c4506aa8-5b37-443b-963c-9b29973750a2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.487550 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c4506aa8-5b37-443b-963c-9b29973750a2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.488034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c4506aa8-5b37-443b-963c-9b29973750a2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.526890 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f3733b8e-dc05-44f6-ae5f-451badc626ac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:13.534578 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f3733b8e-dc05-44f6-ae5f-451badc626ac tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1502 microversion: 2.1 time: 0.160692 Nov 11 20:41:13.535441 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 280/631] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:13 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:13.552206 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7422ee1c-050b-4259-81f4-f48edc5b8cb4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "911460c0-6abe-49bf-82b4-8ef5c42131ea"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:13.553534 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7422ee1c-050b-4259-81f4-f48edc5b8cb4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:13.560260 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7422ee1c-050b-4259-81f4-f48edc5b8cb4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.560704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7422ee1c-050b-4259-81f4-f48edc5b8cb4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.561691 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7422ee1c-050b-4259-81f4-f48edc5b8cb4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.562496 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7422ee1c-050b-4259-81f4-f48edc5b8cb4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.589833 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-7422ee1c-050b-4259-81f4-f48edc5b8cb4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] HTTP exception thrown: Cannot 'attach_volume' instance ddd75246-98f4-4479-be99-f39c6427cc92 while it is in vm_state rescued Nov 11 20:41:13.590803 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7422ee1c-050b-4259-81f4-f48edc5b8cb4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Returning 409 to user: Cannot 'attach_volume' instance ddd75246-98f4-4479-be99-f39c6427cc92 while it is in vm_state rescued {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:41:13.591850 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7422ee1c-050b-4259-81f4-f48edc5b8cb4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "POST /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043561 Nov 11 20:41:13.596233 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 281/632] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:41:13 2021] POST /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 11 20:41:13.601905 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a9434940-516e-4d54-bd23-b520dbfeeabb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:13.602521 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a9434940-516e-4d54-bd23-b520dbfeeabb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:13.608501 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a9434940-516e-4d54-bd23-b520dbfeeabb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.609225 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a9434940-516e-4d54-bd23-b520dbfeeabb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.610026 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a9434940-516e-4d54-bd23-b520dbfeeabb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.610453 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a9434940-516e-4d54-bd23-b520dbfeeabb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.771378 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a9434940-516e-4d54-bd23-b520dbfeeabb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:13.782735 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a9434940-516e-4d54-bd23-b520dbfeeabb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:13.784853 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a9434940-516e-4d54-bd23-b520dbfeeabb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:13.786204 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a9434940-516e-4d54-bd23-b520dbfeeabb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.189027 Nov 11 20:41:13.787214 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 282/633] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:13 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:13.792574 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-24a484c5-f8ad-46bb-836d-2fe391215322 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:13.793423 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-24a484c5-f8ad-46bb-836d-2fe391215322 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:13.799986 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-24a484c5-f8ad-46bb-836d-2fe391215322 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.800743 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-24a484c5-f8ad-46bb-836d-2fe391215322 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.801601 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-24a484c5-f8ad-46bb-836d-2fe391215322 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.802043 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-24a484c5-f8ad-46bb-836d-2fe391215322 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.825249 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c4506aa8-5b37-443b-963c-9b29973750a2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "POST /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363705 Nov 11 20:41:13.832011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 352/634] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:41:13 2021] POST /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:41:13.909318 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-24a484c5-f8ad-46bb-836d-2fe391215322 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "POST /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/action" status: 202 len: 0 microversion: 2.1 time: 0.120637 Nov 11 20:41:13.909986 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 283/635] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:13 2021] POST /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:41:13.920732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2e829d14-8bcc-4dbc-9042-188680567d4b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:13.921511 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2e829d14-8bcc-4dbc-9042-188680567d4b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:13.928155 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2e829d14-8bcc-4dbc-9042-188680567d4b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.928708 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2e829d14-8bcc-4dbc-9042-188680567d4b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:13.929698 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2e829d14-8bcc-4dbc-9042-188680567d4b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:13.930409 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2e829d14-8bcc-4dbc-9042-188680567d4b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:14.117704 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2e829d14-8bcc-4dbc-9042-188680567d4b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:14.125452 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2e829d14-8bcc-4dbc-9042-188680567d4b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1510 microversion: 2.1 time: 0.209959 Nov 11 20:41:14.125950 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 353/636] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:13 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:14.349698 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-39940766-a6ac-428d-aea1-e868c0ddb058 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:14.350801 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-39940766-a6ac-428d-aea1-e868c0ddb058 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:14.357668 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-39940766-a6ac-428d-aea1-e868c0ddb058 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:14.358136 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-39940766-a6ac-428d-aea1-e868c0ddb058 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:14.358990 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-39940766-a6ac-428d-aea1-e868c0ddb058 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:14.359442 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-39940766-a6ac-428d-aea1-e868c0ddb058 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:14.510945 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-39940766-a6ac-428d-aea1-e868c0ddb058 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 20195 microversion: 2.1 time: 0.165219 Nov 11 20:41:14.511640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 284/637] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:14 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 20195 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:14.808559 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-091342f5-ad44-43a3-a60b-3293ae3cdce9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:14.809111 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-091342f5-ad44-43a3-a60b-3293ae3cdce9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:14.817445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-091342f5-ad44-43a3-a60b-3293ae3cdce9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:14.817907 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-091342f5-ad44-43a3-a60b-3293ae3cdce9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:14.818768 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-091342f5-ad44-43a3-a60b-3293ae3cdce9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:14.819845 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-091342f5-ad44-43a3-a60b-3293ae3cdce9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:14.973900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-091342f5-ad44-43a3-a60b-3293ae3cdce9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:14.982999 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-091342f5-ad44-43a3-a60b-3293ae3cdce9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:14.984745 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-091342f5-ad44-43a3-a60b-3293ae3cdce9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:14.985897 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-091342f5-ad44-43a3-a60b-3293ae3cdce9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.181299 Nov 11 20:41:14.986516 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 354/638] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:14 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:15.143761 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-be5928e2-ddfb-4477-9485-6e30e8438b38 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:15.144487 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-be5928e2-ddfb-4477-9485-6e30e8438b38 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:15.152707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be5928e2-ddfb-4477-9485-6e30e8438b38 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:15.153154 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be5928e2-ddfb-4477-9485-6e30e8438b38 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:15.153929 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be5928e2-ddfb-4477-9485-6e30e8438b38 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:15.154377 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be5928e2-ddfb-4477-9485-6e30e8438b38 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:15.296001 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-be5928e2-ddfb-4477-9485-6e30e8438b38 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:15.303899 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-be5928e2-ddfb-4477-9485-6e30e8438b38 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1510 microversion: 2.1 time: 0.163702 Nov 11 20:41:15.304708 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 285/639] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:15 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:15.523340 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-746da6af-6bea-4576-be4c-4353d61d0fae tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:15.524358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-746da6af-6bea-4576-be4c-4353d61d0fae tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:15.532483 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-746da6af-6bea-4576-be4c-4353d61d0fae tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:15.533168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-746da6af-6bea-4576-be4c-4353d61d0fae tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:15.533963 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-746da6af-6bea-4576-be4c-4353d61d0fae tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:15.534435 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-746da6af-6bea-4576-be4c-4353d61d0fae tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:15.693643 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-746da6af-6bea-4576-be4c-4353d61d0fae tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 21282 microversion: 2.1 time: 0.174781 Nov 11 20:41:15.694662 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 355/640] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:15 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 21282 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:16.003413 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1eb01161-1c85-4b2b-a132-27fd79486988 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:16.004058 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1eb01161-1c85-4b2b-a132-27fd79486988 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:16.011747 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1eb01161-1c85-4b2b-a132-27fd79486988 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:16.012235 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1eb01161-1c85-4b2b-a132-27fd79486988 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:16.013032 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1eb01161-1c85-4b2b-a132-27fd79486988 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:16.013465 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1eb01161-1c85-4b2b-a132-27fd79486988 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:16.171133 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-1eb01161-1c85-4b2b-a132-27fd79486988 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:16.179765 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-1eb01161-1c85-4b2b-a132-27fd79486988 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:16.181319 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-1eb01161-1c85-4b2b-a132-27fd79486988 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:16.182475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1eb01161-1c85-4b2b-a132-27fd79486988 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.182661 Nov 11 20:41:16.183023 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 286/641] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:15 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:16.321186 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8651854f-fd2d-4fb6-9fa3-15f1b80d85b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:16.321882 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8651854f-fd2d-4fb6-9fa3-15f1b80d85b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:16.329226 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8651854f-fd2d-4fb6-9fa3-15f1b80d85b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:16.329481 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8651854f-fd2d-4fb6-9fa3-15f1b80d85b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:16.330261 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8651854f-fd2d-4fb6-9fa3-15f1b80d85b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:16.330691 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8651854f-fd2d-4fb6-9fa3-15f1b80d85b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:16.562811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8651854f-fd2d-4fb6-9fa3-15f1b80d85b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:16.572440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8651854f-fd2d-4fb6-9fa3-15f1b80d85b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1510 microversion: 2.1 time: 0.254970 Nov 11 20:41:16.572969 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 356/642] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:16 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:16.705640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-74d1e3f9-1d20-41bc-9810-5feb2eb7e4ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:16.706641 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-74d1e3f9-1d20-41bc-9810-5feb2eb7e4ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:16.714458 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-74d1e3f9-1d20-41bc-9810-5feb2eb7e4ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:16.714907 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-74d1e3f9-1d20-41bc-9810-5feb2eb7e4ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:16.715695 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-74d1e3f9-1d20-41bc-9810-5feb2eb7e4ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:16.716165 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-74d1e3f9-1d20-41bc-9810-5feb2eb7e4ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:16.865532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-74d1e3f9-1d20-41bc-9810-5feb2eb7e4ef tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 22013 microversion: 2.1 time: 0.163911 Nov 11 20:41:16.866158 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 287/643] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:16 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 22013 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:17.209144 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-71138f38-ad91-46d3-ac90-1ed712d54850 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:17.209144 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-71138f38-ad91-46d3-ac90-1ed712d54850 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:17.209144 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-71138f38-ad91-46d3-ac90-1ed712d54850 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:17.210028 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-71138f38-ad91-46d3-ac90-1ed712d54850 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:17.211109 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-71138f38-ad91-46d3-ac90-1ed712d54850 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:17.211570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-71138f38-ad91-46d3-ac90-1ed712d54850 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:17.348835 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-71138f38-ad91-46d3-ac90-1ed712d54850 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:17.357145 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-71138f38-ad91-46d3-ac90-1ed712d54850 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:17.358633 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-71138f38-ad91-46d3-ac90-1ed712d54850 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:17.359774 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-71138f38-ad91-46d3-ac90-1ed712d54850 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.162620 Nov 11 20:41:17.360393 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 357/644] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:17 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:17.590479 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7b59860b-72ce-4152-88ec-3998c7c28d28 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:17.591299 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7b59860b-72ce-4152-88ec-3998c7c28d28 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:17.598707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7b59860b-72ce-4152-88ec-3998c7c28d28 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:17.599162 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7b59860b-72ce-4152-88ec-3998c7c28d28 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:17.600051 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7b59860b-72ce-4152-88ec-3998c7c28d28 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:17.601190 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7b59860b-72ce-4152-88ec-3998c7c28d28 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:17.753910 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7b59860b-72ce-4152-88ec-3998c7c28d28 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:17.761812 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7b59860b-72ce-4152-88ec-3998c7c28d28 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1510 microversion: 2.1 time: 0.176033 Nov 11 20:41:17.762389 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 288/645] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:17 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:17.876945 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4c76e146-a3d7-41d9-9817-52a4c44df558 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:17.877767 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4c76e146-a3d7-41d9-9817-52a4c44df558 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:17.885235 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4c76e146-a3d7-41d9-9817-52a4c44df558 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:17.885683 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4c76e146-a3d7-41d9-9817-52a4c44df558 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:17.886727 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4c76e146-a3d7-41d9-9817-52a4c44df558 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:17.887158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4c76e146-a3d7-41d9-9817-52a4c44df558 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:18.047274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4c76e146-a3d7-41d9-9817-52a4c44df558 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 22836 microversion: 2.1 time: 0.173880 Nov 11 20:41:18.048010 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 358/646] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:17 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 22836 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:18.378621 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b0619ffc-d5a7-4f75-9933-1d57f3174101 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:18.379222 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b0619ffc-d5a7-4f75-9933-1d57f3174101 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:18.386535 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b0619ffc-d5a7-4f75-9933-1d57f3174101 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:18.386982 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b0619ffc-d5a7-4f75-9933-1d57f3174101 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:18.387766 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b0619ffc-d5a7-4f75-9933-1d57f3174101 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:18.388231 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b0619ffc-d5a7-4f75-9933-1d57f3174101 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:18.520790 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b0619ffc-d5a7-4f75-9933-1d57f3174101 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:18.532557 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b0619ffc-d5a7-4f75-9933-1d57f3174101 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:18.534301 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b0619ffc-d5a7-4f75-9933-1d57f3174101 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:18.535533 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b0619ffc-d5a7-4f75-9933-1d57f3174101 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.160642 Nov 11 20:41:18.536150 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 289/647] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:18 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:18.779819 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-127ff3f9-6ded-4f69-8f7e-446e3bfdd9aa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:18.780539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-127ff3f9-6ded-4f69-8f7e-446e3bfdd9aa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:18.787201 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-127ff3f9-6ded-4f69-8f7e-446e3bfdd9aa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:18.787695 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-127ff3f9-6ded-4f69-8f7e-446e3bfdd9aa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:18.788588 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-127ff3f9-6ded-4f69-8f7e-446e3bfdd9aa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:18.789014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-127ff3f9-6ded-4f69-8f7e-446e3bfdd9aa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:18.932275 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-127ff3f9-6ded-4f69-8f7e-446e3bfdd9aa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:18.939682 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-127ff3f9-6ded-4f69-8f7e-446e3bfdd9aa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1510 microversion: 2.1 time: 0.163784 Nov 11 20:41:18.940282 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 359/648] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:18 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:19.059281 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-493b979b-e81c-4705-a785-742364aa8a38 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:19.060266 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-493b979b-e81c-4705-a785-742364aa8a38 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:19.066523 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-493b979b-e81c-4705-a785-742364aa8a38 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:19.066971 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-493b979b-e81c-4705-a785-742364aa8a38 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:19.067745 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-493b979b-e81c-4705-a785-742364aa8a38 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:19.068217 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-493b979b-e81c-4705-a785-742364aa8a38 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:19.308409 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-493b979b-e81c-4705-a785-742364aa8a38 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 23173 microversion: 2.1 time: 0.252593 Nov 11 20:41:19.309232 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 290/649] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:19 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 23173 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:41:19.594632 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c916c9d2-f6d4-49c0-b190-80abcfe9e9cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:19.595260 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c916c9d2-f6d4-49c0-b190-80abcfe9e9cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:19.603427 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c916c9d2-f6d4-49c0-b190-80abcfe9e9cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:19.603911 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c916c9d2-f6d4-49c0-b190-80abcfe9e9cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:19.604738 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c916c9d2-f6d4-49c0-b190-80abcfe9e9cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:19.605430 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c916c9d2-f6d4-49c0-b190-80abcfe9e9cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:19.740683 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c916c9d2-f6d4-49c0-b190-80abcfe9e9cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:19.748390 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c916c9d2-f6d4-49c0-b190-80abcfe9e9cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:19.749882 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c916c9d2-f6d4-49c0-b190-80abcfe9e9cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:19.751024 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c916c9d2-f6d4-49c0-b190-80abcfe9e9cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.160340 Nov 11 20:41:19.751575 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 360/650] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:19 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:19.958985 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5ca6c092-8c62-438c-bf88-d9b4c931da36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:19.960132 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5ca6c092-8c62-438c-bf88-d9b4c931da36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:19.967144 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5ca6c092-8c62-438c-bf88-d9b4c931da36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:19.967589 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5ca6c092-8c62-438c-bf88-d9b4c931da36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:19.968399 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5ca6c092-8c62-438c-bf88-d9b4c931da36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:19.968828 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5ca6c092-8c62-438c-bf88-d9b4c931da36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:20.106919 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5ca6c092-8c62-438c-bf88-d9b4c931da36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:20.114200 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5ca6c092-8c62-438c-bf88-d9b4c931da36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1510 microversion: 2.1 time: 0.159336 Nov 11 20:41:20.114767 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 291/651] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:19 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:20.322204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ee4fc36e-8b96-4eb6-9633-072e470100eb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:20.323119 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ee4fc36e-8b96-4eb6-9633-072e470100eb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:20.329612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ee4fc36e-8b96-4eb6-9633-072e470100eb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:20.330061 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ee4fc36e-8b96-4eb6-9633-072e470100eb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:20.330837 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ee4fc36e-8b96-4eb6-9633-072e470100eb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:20.331262 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ee4fc36e-8b96-4eb6-9633-072e470100eb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:20.510380 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ee4fc36e-8b96-4eb6-9633-072e470100eb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 23426 microversion: 2.1 time: 0.192158 Nov 11 20:41:20.511078 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 361/652] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:20 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 23426 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:20.768921 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-692745f3-2a19-43c2-a9f3-db2929dd3aef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:20.769440 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-692745f3-2a19-43c2-a9f3-db2929dd3aef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:20.775613 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-692745f3-2a19-43c2-a9f3-db2929dd3aef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:20.776081 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-692745f3-2a19-43c2-a9f3-db2929dd3aef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:20.776851 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-692745f3-2a19-43c2-a9f3-db2929dd3aef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:20.777278 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-692745f3-2a19-43c2-a9f3-db2929dd3aef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:20.919245 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-692745f3-2a19-43c2-a9f3-db2929dd3aef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:20.927334 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-692745f3-2a19-43c2-a9f3-db2929dd3aef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:20.929704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-692745f3-2a19-43c2-a9f3-db2929dd3aef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:20.930854 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-692745f3-2a19-43c2-a9f3-db2929dd3aef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.165761 Nov 11 20:41:20.931405 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 292/653] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:20 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:21.130989 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b5ec2097-8ab5-487c-a091-1424d42c8be6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:21.131676 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b5ec2097-8ab5-487c-a091-1424d42c8be6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:21.138988 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b5ec2097-8ab5-487c-a091-1424d42c8be6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:21.139657 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b5ec2097-8ab5-487c-a091-1424d42c8be6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:21.140685 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b5ec2097-8ab5-487c-a091-1424d42c8be6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:21.141508 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b5ec2097-8ab5-487c-a091-1424d42c8be6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:21.333327 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b5ec2097-8ab5-487c-a091-1424d42c8be6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:21.342442 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b5ec2097-8ab5-487c-a091-1424d42c8be6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1516 microversion: 2.1 time: 0.215498 Nov 11 20:41:21.343014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 362/654] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:21 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1516 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:21.523597 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fa89d0ec-89d1-47d8-a198-d157131d5280 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:21.524676 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fa89d0ec-89d1-47d8-a198-d157131d5280 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:21.532669 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa89d0ec-89d1-47d8-a198-d157131d5280 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:21.533506 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa89d0ec-89d1-47d8-a198-d157131d5280 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:21.535031 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa89d0ec-89d1-47d8-a198-d157131d5280 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:21.535939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fa89d0ec-89d1-47d8-a198-d157131d5280 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:21.717582 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fa89d0ec-89d1-47d8-a198-d157131d5280 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 23786 microversion: 2.1 time: 0.198614 Nov 11 20:41:21.718352 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 293/655] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:21 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 23786 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:41:21.950056 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4b626614-e509-4be9-afdb-d2741df0c581 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:21.950853 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4b626614-e509-4be9-afdb-d2741df0c581 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:21.956943 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4b626614-e509-4be9-afdb-d2741df0c581 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:21.957454 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4b626614-e509-4be9-afdb-d2741df0c581 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:21.958417 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4b626614-e509-4be9-afdb-d2741df0c581 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:21.959016 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4b626614-e509-4be9-afdb-d2741df0c581 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:22.108604 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4b626614-e509-4be9-afdb-d2741df0c581 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:22.116788 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4b626614-e509-4be9-afdb-d2741df0c581 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:22.118289 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4b626614-e509-4be9-afdb-d2741df0c581 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:22.119431 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4b626614-e509-4be9-afdb-d2741df0c581 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.173815 Nov 11 20:41:22.119995 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 363/656] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:21 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:22.730363 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0a196fb0-5c35-4735-8971-aa6d2bebab9d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:22.731475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0a196fb0-5c35-4735-8971-aa6d2bebab9d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:22.739260 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a196fb0-5c35-4735-8971-aa6d2bebab9d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:22.739788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a196fb0-5c35-4735-8971-aa6d2bebab9d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:22.741382 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a196fb0-5c35-4735-8971-aa6d2bebab9d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:22.741864 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0a196fb0-5c35-4735-8971-aa6d2bebab9d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:22.763622 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a9a377d9-a9b5-4329-aeee-53ea02f422ad tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:22.763622 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a9a377d9-a9b5-4329-aeee-53ea02f422ad tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:22.771765 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9a377d9-a9b5-4329-aeee-53ea02f422ad tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:22.773080 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9a377d9-a9b5-4329-aeee-53ea02f422ad tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:22.774287 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9a377d9-a9b5-4329-aeee-53ea02f422ad tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:22.774727 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9a377d9-a9b5-4329-aeee-53ea02f422ad tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:22.908548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a9a377d9-a9b5-4329-aeee-53ea02f422ad tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:22.918352 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a9a377d9-a9b5-4329-aeee-53ea02f422ad tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1516 microversion: 2.1 time: 0.159524 Nov 11 20:41:22.919174 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 364/657] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:22 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:22.921013 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0a196fb0-5c35-4735-8971-aa6d2bebab9d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 24230 microversion: 2.1 time: 0.195303 Nov 11 20:41:22.921642 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 294/658] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:22 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 24230 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:22.935544 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-917c7035-bea6-4550-bcee-1ccaa36d0022 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5be2936-3d74-42c2-9f7d-2d5684aeddc4"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:22.936704 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-917c7035-bea6-4550-bcee-1ccaa36d0022 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:22.942811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-917c7035-bea6-4550-bcee-1ccaa36d0022 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:22.943472 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-917c7035-bea6-4550-bcee-1ccaa36d0022 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:22.944475 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-917c7035-bea6-4550-bcee-1ccaa36d0022 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:22.945110 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-917c7035-bea6-4550-bcee-1ccaa36d0022 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:23.138396 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-546102cf-3424-4cf9-9dfe-22b7e8dc6634 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:23.139410 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-546102cf-3424-4cf9-9dfe-22b7e8dc6634 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:23.146863 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-546102cf-3424-4cf9-9dfe-22b7e8dc6634 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:23.148176 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-546102cf-3424-4cf9-9dfe-22b7e8dc6634 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:23.149265 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-546102cf-3424-4cf9-9dfe-22b7e8dc6634 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:23.149712 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-546102cf-3424-4cf9-9dfe-22b7e8dc6634 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:23.262019 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-917c7035-bea6-4550-bcee-1ccaa36d0022 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "POST /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329969 Nov 11 20:41:23.263283 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 365/659] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:41:22 2021] POST /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:41:23.317895 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-546102cf-3424-4cf9-9dfe-22b7e8dc6634 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:23.327493 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-546102cf-3424-4cf9-9dfe-22b7e8dc6634 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:23.329706 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-546102cf-3424-4cf9-9dfe-22b7e8dc6634 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:23.331040 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-546102cf-3424-4cf9-9dfe-22b7e8dc6634 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.196732 Nov 11 20:41:23.332067 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 295/660] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:23 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:23.594169 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2ac42e95-e83a-4e58-9819-8a86fb6db51d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:23.594740 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2ac42e95-e83a-4e58-9819-8a86fb6db51d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:23.601535 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2ac42e95-e83a-4e58-9819-8a86fb6db51d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:23.601971 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2ac42e95-e83a-4e58-9819-8a86fb6db51d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:23.602740 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2ac42e95-e83a-4e58-9819-8a86fb6db51d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:23.603164 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2ac42e95-e83a-4e58-9819-8a86fb6db51d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:23.687302 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-2ac42e95-e83a-4e58-9819-8a86fb6db51d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lazy-loading 'services' on Instance uuid 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:41:23.761243 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2ac42e95-e83a-4e58-9819-8a86fb6db51d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments/b1ef5cc3-eb92-46d5-91d9-e4180db90910" status: 202 len: 0 microversion: 2.1 time: 0.170991 Nov 11 20:41:23.762095 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 366/661] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Nov 11 20:41:23 2021] DELETE /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments/b1ef5cc3-eb92-46d5-91d9-e4180db90910 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:41:23.770118 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5649acb5-9b48-4a2a-93a2-3e4cde6a1057 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:23.771122 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5649acb5-9b48-4a2a-93a2-3e4cde6a1057 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:23.778605 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5649acb5-9b48-4a2a-93a2-3e4cde6a1057 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:23.778605 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5649acb5-9b48-4a2a-93a2-3e4cde6a1057 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:23.779619 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5649acb5-9b48-4a2a-93a2-3e4cde6a1057 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:23.779812 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5649acb5-9b48-4a2a-93a2-3e4cde6a1057 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:23.814957 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5649acb5-9b48-4a2a-93a2-3e4cde6a1057 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048693 Nov 11 20:41:23.815524 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 296/662] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:41:23 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:41:23.934539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-66093624-b667-4b4c-8724-ca1eacb50c72 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:23.935627 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-66093624-b667-4b4c-8724-ca1eacb50c72 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:23.942958 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-66093624-b667-4b4c-8724-ca1eacb50c72 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:23.943435 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-66093624-b667-4b4c-8724-ca1eacb50c72 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:23.944656 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-66093624-b667-4b4c-8724-ca1eacb50c72 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:23.945488 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-66093624-b667-4b4c-8724-ca1eacb50c72 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:24.149405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-66093624-b667-4b4c-8724-ca1eacb50c72 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 24511 microversion: 2.1 time: 0.219393 Nov 11 20:41:24.150049 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 367/663] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:23 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 24511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:24.351026 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c751e4b6-45f0-46e4-a6b7-935bb5b88c50 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:24.351866 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c751e4b6-45f0-46e4-a6b7-935bb5b88c50 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:24.357981 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c751e4b6-45f0-46e4-a6b7-935bb5b88c50 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:24.358412 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c751e4b6-45f0-46e4-a6b7-935bb5b88c50 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:24.359190 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c751e4b6-45f0-46e4-a6b7-935bb5b88c50 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:24.359619 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c751e4b6-45f0-46e4-a6b7-935bb5b88c50 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:24.501086 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c751e4b6-45f0-46e4-a6b7-935bb5b88c50 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:24.512049 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c751e4b6-45f0-46e4-a6b7-935bb5b88c50 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:24.513690 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c751e4b6-45f0-46e4-a6b7-935bb5b88c50 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:24.514892 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c751e4b6-45f0-46e4-a6b7-935bb5b88c50 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.168712 Nov 11 20:41:24.515793 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 297/664] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:24 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:24.828092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0ab252af-db02-498d-9031-cad1b218c4cb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:24.829417 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0ab252af-db02-498d-9031-cad1b218c4cb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:24.837521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ab252af-db02-498d-9031-cad1b218c4cb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:24.838222 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ab252af-db02-498d-9031-cad1b218c4cb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:24.839236 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ab252af-db02-498d-9031-cad1b218c4cb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:24.839674 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ab252af-db02-498d-9031-cad1b218c4cb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:24.872092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0ab252af-db02-498d-9031-cad1b218c4cb tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048068 Nov 11 20:41:24.872845 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 368/665] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:41:24 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:41:25.161230 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7468a359-fe66-4633-b83e-99eab477302f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:25.162146 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7468a359-fe66-4633-b83e-99eab477302f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:25.169426 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7468a359-fe66-4633-b83e-99eab477302f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:25.170385 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7468a359-fe66-4633-b83e-99eab477302f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:25.171426 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7468a359-fe66-4633-b83e-99eab477302f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:25.172430 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7468a359-fe66-4633-b83e-99eab477302f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:25.344503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7468a359-fe66-4633-b83e-99eab477302f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 24935 microversion: 2.1 time: 0.187087 Nov 11 20:41:25.348877 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 298/666] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:25 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 24935 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:25.534177 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0bcc6b45-82d5-4465-8f05-6d71f48bc959 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:25.534783 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0bcc6b45-82d5-4465-8f05-6d71f48bc959 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:25.542539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0bcc6b45-82d5-4465-8f05-6d71f48bc959 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:25.543137 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0bcc6b45-82d5-4465-8f05-6d71f48bc959 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:25.544256 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0bcc6b45-82d5-4465-8f05-6d71f48bc959 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:25.544695 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0bcc6b45-82d5-4465-8f05-6d71f48bc959 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:25.690665 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0bcc6b45-82d5-4465-8f05-6d71f48bc959 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:25.698591 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0bcc6b45-82d5-4465-8f05-6d71f48bc959 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:25.700275 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0bcc6b45-82d5-4465-8f05-6d71f48bc959 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:25.701422 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0bcc6b45-82d5-4465-8f05-6d71f48bc959 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.171328 Nov 11 20:41:25.701968 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 369/667] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:25 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:25.884185 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5d532f46-8c11-4a53-99f8-ee78b886e95e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:25.885192 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5d532f46-8c11-4a53-99f8-ee78b886e95e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:25.892784 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d532f46-8c11-4a53-99f8-ee78b886e95e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:25.893223 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d532f46-8c11-4a53-99f8-ee78b886e95e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:25.894074 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d532f46-8c11-4a53-99f8-ee78b886e95e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:25.894532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d532f46-8c11-4a53-99f8-ee78b886e95e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:25.927299 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5d532f46-8c11-4a53-99f8-ee78b886e95e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047285 Nov 11 20:41:25.928269 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 299/668] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:41:25 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:41:26.357058 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-41428346-e1a7-4419-8cfd-da6cc1c5f537 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:26.358699 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-41428346-e1a7-4419-8cfd-da6cc1c5f537 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:26.366210 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-41428346-e1a7-4419-8cfd-da6cc1c5f537 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:26.367133 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-41428346-e1a7-4419-8cfd-da6cc1c5f537 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:26.368322 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-41428346-e1a7-4419-8cfd-da6cc1c5f537 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:26.369158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-41428346-e1a7-4419-8cfd-da6cc1c5f537 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:26.586155 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-41428346-e1a7-4419-8cfd-da6cc1c5f537 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 25595 microversion: 2.1 time: 0.232805 Nov 11 20:41:26.587355 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 370/669] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:26 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 25595 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:26.721024 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-038c79a1-e5a9-4a47-9da9-480bc394ec7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:26.722376 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-038c79a1-e5a9-4a47-9da9-480bc394ec7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:26.729135 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-038c79a1-e5a9-4a47-9da9-480bc394ec7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:26.729584 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-038c79a1-e5a9-4a47-9da9-480bc394ec7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:26.730360 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-038c79a1-e5a9-4a47-9da9-480bc394ec7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:26.730785 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-038c79a1-e5a9-4a47-9da9-480bc394ec7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:26.885860 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-038c79a1-e5a9-4a47-9da9-480bc394ec7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:26.894123 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-038c79a1-e5a9-4a47-9da9-480bc394ec7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:26.895695 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-038c79a1-e5a9-4a47-9da9-480bc394ec7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:26.897484 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-038c79a1-e5a9-4a47-9da9-480bc394ec7f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.180258 Nov 11 20:41:26.898399 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 300/670] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:26 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:26.940718 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d1e4a074-5517-45ed-9362-b8f1238027d4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:26.941734 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d1e4a074-5517-45ed-9362-b8f1238027d4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:26.949579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d1e4a074-5517-45ed-9362-b8f1238027d4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:26.949876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d1e4a074-5517-45ed-9362-b8f1238027d4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:26.950868 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d1e4a074-5517-45ed-9362-b8f1238027d4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:26.951476 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d1e4a074-5517-45ed-9362-b8f1238027d4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:26.983225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d1e4a074-5517-45ed-9362-b8f1238027d4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046654 Nov 11 20:41:26.986262 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 371/671] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:41:26 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:41:27.599689 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-12b216a1-5240-4afb-97c8-c3a7b8b13340 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:27.601286 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-12b216a1-5240-4afb-97c8-c3a7b8b13340 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:27.607712 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-12b216a1-5240-4afb-97c8-c3a7b8b13340 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:27.608146 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-12b216a1-5240-4afb-97c8-c3a7b8b13340 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:27.608938 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-12b216a1-5240-4afb-97c8-c3a7b8b13340 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:27.609419 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-12b216a1-5240-4afb-97c8-c3a7b8b13340 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:27.798657 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-12b216a1-5240-4afb-97c8-c3a7b8b13340 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 26354 microversion: 2.1 time: 0.203195 Nov 11 20:41:27.800520 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 301/672] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:27 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 26354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:27.917849 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-306a05a5-1315-4df5-9b87-b3e386bb7a2e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:27.918602 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-306a05a5-1315-4df5-9b87-b3e386bb7a2e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:27.924986 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-306a05a5-1315-4df5-9b87-b3e386bb7a2e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:27.925486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-306a05a5-1315-4df5-9b87-b3e386bb7a2e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:27.926274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-306a05a5-1315-4df5-9b87-b3e386bb7a2e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:27.926707 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-306a05a5-1315-4df5-9b87-b3e386bb7a2e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:28.001127 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8e43c583-a241-44dd-b4c1-90a2f76f187b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:28.002359 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8e43c583-a241-44dd-b4c1-90a2f76f187b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:28.010734 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8e43c583-a241-44dd-b4c1-90a2f76f187b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:28.011550 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8e43c583-a241-44dd-b4c1-90a2f76f187b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:28.012602 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8e43c583-a241-44dd-b4c1-90a2f76f187b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:28.013238 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8e43c583-a241-44dd-b4c1-90a2f76f187b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:28.045464 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8e43c583-a241-44dd-b4c1-90a2f76f187b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054374 Nov 11 20:41:28.046152 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 302/673] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:41:27 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:41:28.079294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-306a05a5-1315-4df5-9b87-b3e386bb7a2e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:28.088372 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-306a05a5-1315-4df5-9b87-b3e386bb7a2e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:28.090262 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-306a05a5-1315-4df5-9b87-b3e386bb7a2e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:28.091710 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-306a05a5-1315-4df5-9b87-b3e386bb7a2e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1744 microversion: 2.20 time: 0.178216 Nov 11 20:41:28.103676 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 372/674] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:27 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:28.810620 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0d9d56ed-d4a1-4c1f-a857-e8fb23ef1a85 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:28.811560 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0d9d56ed-d4a1-4c1f-a857-e8fb23ef1a85 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:28.818605 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d9d56ed-d4a1-4c1f-a857-e8fb23ef1a85 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:28.819251 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d9d56ed-d4a1-4c1f-a857-e8fb23ef1a85 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:28.820215 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d9d56ed-d4a1-4c1f-a857-e8fb23ef1a85 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:28.820831 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d9d56ed-d4a1-4c1f-a857-e8fb23ef1a85 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:29.037699 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0d9d56ed-d4a1-4c1f-a857-e8fb23ef1a85 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 26653 microversion: 2.1 time: 0.230592 Nov 11 20:41:29.039301 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 303/675] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:28 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 26653 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:29.056758 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-60fbac8c-53fc-4865-9a40-c0c23b9f4a7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:29.057671 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-60fbac8c-53fc-4865-9a40-c0c23b9f4a7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:29.064182 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-60fbac8c-53fc-4865-9a40-c0c23b9f4a7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:29.064665 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-60fbac8c-53fc-4865-9a40-c0c23b9f4a7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:29.065608 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-60fbac8c-53fc-4865-9a40-c0c23b9f4a7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:29.066108 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-60fbac8c-53fc-4865-9a40-c0c23b9f4a7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:29.098020 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-60fbac8c-53fc-4865-9a40-c0c23b9f4a7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Nov 11 20:41:29.098576 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 373/676] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:41:29 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:41:29.111592 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b05fd01d-ae85-49b8-80da-9d6d6ea8b77e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:29.112350 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b05fd01d-ae85-49b8-80da-9d6d6ea8b77e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:29.119867 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b05fd01d-ae85-49b8-80da-9d6d6ea8b77e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:29.120347 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b05fd01d-ae85-49b8-80da-9d6d6ea8b77e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:29.121127 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b05fd01d-ae85-49b8-80da-9d6d6ea8b77e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:29.121563 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b05fd01d-ae85-49b8-80da-9d6d6ea8b77e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:29.260345 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b05fd01d-ae85-49b8-80da-9d6d6ea8b77e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:29.268549 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b05fd01d-ae85-49b8-80da-9d6d6ea8b77e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:29.270103 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b05fd01d-ae85-49b8-80da-9d6d6ea8b77e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:29.271201 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b05fd01d-ae85-49b8-80da-9d6d6ea8b77e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1744 microversion: 2.20 time: 0.163670 Nov 11 20:41:29.271752 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 304/677] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:29 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:29.832909 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6692cd4a-6cc5-44bb-a098-a917da867161 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29a0f441-da9e-40af-a630-be24dfada5b8", "device": "/dev/sdb"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:29.834700 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6692cd4a-6cc5-44bb-a098-a917da867161 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:29.841241 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6692cd4a-6cc5-44bb-a098-a917da867161 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:29.841696 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6692cd4a-6cc5-44bb-a098-a917da867161 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:29.842485 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6692cd4a-6cc5-44bb-a098-a917da867161 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:29.842917 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6692cd4a-6cc5-44bb-a098-a917da867161 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:30.050598 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2e78d397-d7ba-40b8-a176-6b6f91fa6ddb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:30.051540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2e78d397-d7ba-40b8-a176-6b6f91fa6ddb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:30.060922 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e78d397-d7ba-40b8-a176-6b6f91fa6ddb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:30.061386 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e78d397-d7ba-40b8-a176-6b6f91fa6ddb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:30.062181 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e78d397-d7ba-40b8-a176-6b6f91fa6ddb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:30.062907 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e78d397-d7ba-40b8-a176-6b6f91fa6ddb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:30.149599 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6692cd4a-6cc5-44bb-a098-a917da867161 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "POST /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320261 Nov 11 20:41:30.150148 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 374/678] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:41:29 2021] POST /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:41:30.155691 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2866a8a1-0dac-4d54-abb3-80eb19c75107 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:30.156833 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2866a8a1-0dac-4d54-abb3-80eb19c75107 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:30.172764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2866a8a1-0dac-4d54-abb3-80eb19c75107 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:30.173270 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2866a8a1-0dac-4d54-abb3-80eb19c75107 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:30.174108 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2866a8a1-0dac-4d54-abb3-80eb19c75107 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:30.174978 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2866a8a1-0dac-4d54-abb3-80eb19c75107 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:30.208721 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2866a8a1-0dac-4d54-abb3-80eb19c75107 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057348 Nov 11 20:41:30.209504 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 375/679] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:41:30 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:41:30.290407 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-342716cc-fcdc-42bd-90a7-c6e9fca8f437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:30.291103 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-342716cc-fcdc-42bd-90a7-c6e9fca8f437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:30.297628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-342716cc-fcdc-42bd-90a7-c6e9fca8f437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:30.298078 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-342716cc-fcdc-42bd-90a7-c6e9fca8f437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:30.298865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-342716cc-fcdc-42bd-90a7-c6e9fca8f437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:30.299309 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-342716cc-fcdc-42bd-90a7-c6e9fca8f437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:30.383537 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2e78d397-d7ba-40b8-a176-6b6f91fa6ddb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 26925 microversion: 2.1 time: 0.336904 Nov 11 20:41:30.384991 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 305/680] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:30 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 26925 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:41:30.450462 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-342716cc-fcdc-42bd-90a7-c6e9fca8f437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:30.459199 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-342716cc-fcdc-42bd-90a7-c6e9fca8f437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:30.461251 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-342716cc-fcdc-42bd-90a7-c6e9fca8f437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:30.462631 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-342716cc-fcdc-42bd-90a7-c6e9fca8f437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1744 microversion: 2.20 time: 0.176596 Nov 11 20:41:30.463186 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 376/681] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:30 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:31.220851 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-32195296-73eb-4a04-b864-a5e4ceb0ba3c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:31.228734 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-32195296-73eb-4a04-b864-a5e4ceb0ba3c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:31.238689 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-32195296-73eb-4a04-b864-a5e4ceb0ba3c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:31.239127 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-32195296-73eb-4a04-b864-a5e4ceb0ba3c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:31.239911 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-32195296-73eb-4a04-b864-a5e4ceb0ba3c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:31.240369 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-32195296-73eb-4a04-b864-a5e4ceb0ba3c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:31.278909 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-32195296-73eb-4a04-b864-a5e4ceb0ba3c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062437 Nov 11 20:41:31.280394 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 306/682] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:41:31 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:41:31.400897 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-930cdc7f-3726-4985-879c-0ff1455f373a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:31.401807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-930cdc7f-3726-4985-879c-0ff1455f373a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:31.408153 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-930cdc7f-3726-4985-879c-0ff1455f373a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:31.408604 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-930cdc7f-3726-4985-879c-0ff1455f373a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:31.409378 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-930cdc7f-3726-4985-879c-0ff1455f373a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:31.409811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-930cdc7f-3726-4985-879c-0ff1455f373a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:31.480273 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a8e67280-4c54-42b0-9aef-e2a52178f7d1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:31.480816 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a8e67280-4c54-42b0-9aef-e2a52178f7d1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:31.487145 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a8e67280-4c54-42b0-9aef-e2a52178f7d1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:31.487589 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a8e67280-4c54-42b0-9aef-e2a52178f7d1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:31.488397 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a8e67280-4c54-42b0-9aef-e2a52178f7d1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:31.488828 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a8e67280-4c54-42b0-9aef-e2a52178f7d1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:31.639640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a8e67280-4c54-42b0-9aef-e2a52178f7d1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:31.648745 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a8e67280-4c54-42b0-9aef-e2a52178f7d1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:31.650573 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a8e67280-4c54-42b0-9aef-e2a52178f7d1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:31.651590 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-930cdc7f-3726-4985-879c-0ff1455f373a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 27130 microversion: 2.1 time: 0.254924 Nov 11 20:41:31.652316 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a8e67280-4c54-42b0-9aef-e2a52178f7d1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1744 microversion: 2.20 time: 0.175467 Nov 11 20:41:31.652662 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 377/683] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:31 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 27130 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:31.653245 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 307/684] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:31 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:31.718282 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-824ca607-6054-45d5-b48a-16dbf8d3097f req-f0752538-efbd-4c04-9421-8b41966e9166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4a9f51-80d0-4901-beaf-9b03435f002c", "name": "network-vif-plugged", "status": "completed", "tag": "bc0e19f0-bdca-4923-a0c3-77ad0c202bdc"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:31.722013 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:41:31.722013 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:41:31.742684 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-824ca607-6054-45d5-b48a-16dbf8d3097f req-f0752538-efbd-4c04-9421-8b41966e9166 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:31.743605 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-824ca607-6054-45d5-b48a-16dbf8d3097f req-f0752538-efbd-4c04-9421-8b41966e9166 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:31.769925 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-824ca607-6054-45d5-b48a-16dbf8d3097f req-f0752538-efbd-4c04-9421-8b41966e9166 service nova] Creating event network-vif-plugged:bc0e19f0-bdca-4923-a0c3-77ad0c202bdc for instance ce4a9f51-80d0-4901-beaf-9b03435f002c on hv-cinder-81764 Nov 11 20:41:31.788975 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-824ca607-6054-45d5-b48a-16dbf8d3097f req-f0752538-efbd-4c04-9421-8b41966e9166 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076210 Nov 11 20:41:31.790136 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 378/685] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:41:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:41:32.290536 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-018da2a1-9001-462b-8e4a-878af85368fa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:32.292157 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-018da2a1-9001-462b-8e4a-878af85368fa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:32.298457 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-018da2a1-9001-462b-8e4a-878af85368fa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:32.298896 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-018da2a1-9001-462b-8e4a-878af85368fa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:32.299718 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-018da2a1-9001-462b-8e4a-878af85368fa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:32.300201 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-018da2a1-9001-462b-8e4a-878af85368fa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:32.332356 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-018da2a1-9001-462b-8e4a-878af85368fa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046124 Nov 11 20:41:32.333008 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 308/686] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:41:32 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:41:32.665649 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b2910bcc-ec59-46bf-bdaf-b039e2199aa4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:32.671507 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b2910bcc-ec59-46bf-bdaf-b039e2199aa4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:32.674718 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-aa2952f9-7a35-4814-bb17-5ea8688f2b0c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:32.675568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-aa2952f9-7a35-4814-bb17-5ea8688f2b0c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:32.686155 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aa2952f9-7a35-4814-bb17-5ea8688f2b0c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:32.687341 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aa2952f9-7a35-4814-bb17-5ea8688f2b0c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:32.688344 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aa2952f9-7a35-4814-bb17-5ea8688f2b0c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:32.688514 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b2910bcc-ec59-46bf-bdaf-b039e2199aa4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:32.689191 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aa2952f9-7a35-4814-bb17-5ea8688f2b0c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:32.690027 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b2910bcc-ec59-46bf-bdaf-b039e2199aa4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:32.691195 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b2910bcc-ec59-46bf-bdaf-b039e2199aa4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:32.693995 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b2910bcc-ec59-46bf-bdaf-b039e2199aa4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:32.872122 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-aa2952f9-7a35-4814-bb17-5ea8688f2b0c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:32.886384 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-aa2952f9-7a35-4814-bb17-5ea8688f2b0c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:32.889297 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-aa2952f9-7a35-4814-bb17-5ea8688f2b0c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:32.890733 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-aa2952f9-7a35-4814-bb17-5ea8688f2b0c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1739 microversion: 2.20 time: 0.220463 Nov 11 20:41:32.891516 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 309/687] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:32 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:32.933859 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7b43c141-777f-4f81-9d5b-678280ceaa16 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:32.934909 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7b43c141-777f-4f81-9d5b-678280ceaa16 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:32.942322 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b2910bcc-ec59-46bf-bdaf-b039e2199aa4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 27375 microversion: 2.1 time: 0.281758 Nov 11 20:41:32.942684 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7b43c141-777f-4f81-9d5b-678280ceaa16 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:32.945069 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7b43c141-777f-4f81-9d5b-678280ceaa16 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:32.945069 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7b43c141-777f-4f81-9d5b-678280ceaa16 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:32.947963 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7b43c141-777f-4f81-9d5b-678280ceaa16 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:32.949433 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 379/688] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:32 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 27375 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:32.984197 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.objects.instance [None req-7b43c141-777f-4f81-9d5b-678280ceaa16 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lazy-loading 'flavor' on Instance uuid ddd75246-98f4-4479-be99-f39c6427cc92 {{(pid=122527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:41:33.270133 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7b43c141-777f-4f81-9d5b-678280ceaa16 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "POST /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/action" status: 200 len: 32 microversion: 2.1 time: 0.283346 Nov 11 20:41:33.270133 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 310/689] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:32 2021] POST /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/action => generated 32 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:41:33.301352 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-dc520b7a-69fe-47f7-848a-7bf21fa53d2f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:33.303198 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-dc520b7a-69fe-47f7-848a-7bf21fa53d2f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:33.347144 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1b1b435c-0703-4c79-87cc-286c9f0a245f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:33.349050 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1b1b435c-0703-4c79-87cc-286c9f0a245f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:33.378278 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dc520b7a-69fe-47f7-848a-7bf21fa53d2f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:33.383439 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dc520b7a-69fe-47f7-848a-7bf21fa53d2f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:33.386912 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dc520b7a-69fe-47f7-848a-7bf21fa53d2f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:33.388708 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dc520b7a-69fe-47f7-848a-7bf21fa53d2f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:33.417355 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b1b435c-0703-4c79-87cc-286c9f0a245f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:33.419767 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b1b435c-0703-4c79-87cc-286c9f0a245f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:33.436856 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b1b435c-0703-4c79-87cc-286c9f0a245f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:33.444137 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1b1b435c-0703-4c79-87cc-286c9f0a245f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:33.584221 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1b1b435c-0703-4c79-87cc-286c9f0a245f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.242692 Nov 11 20:41:33.591906 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 311/690] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:41:33 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:41:33.796977 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-dc520b7a-69fe-47f7-848a-7bf21fa53d2f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:33.813552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-dc520b7a-69fe-47f7-848a-7bf21fa53d2f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.522733 Nov 11 20:41:33.814739 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 380/691] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:33 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:33.911388 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-32fa5f03-f057-465f-8bb8-030f85dc865b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:33.912492 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-32fa5f03-f057-465f-8bb8-030f85dc865b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:33.934488 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-32fa5f03-f057-465f-8bb8-030f85dc865b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:33.934990 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-32fa5f03-f057-465f-8bb8-030f85dc865b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:33.935827 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-32fa5f03-f057-465f-8bb8-030f85dc865b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:33.936331 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-32fa5f03-f057-465f-8bb8-030f85dc865b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:33.964472 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-25752abc-4ab5-42f6-be69-b2ef0baa2d6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:33.966427 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-25752abc-4ab5-42f6-be69-b2ef0baa2d6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:33.984201 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-25752abc-4ab5-42f6-be69-b2ef0baa2d6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:33.985038 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-25752abc-4ab5-42f6-be69-b2ef0baa2d6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:33.986368 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-25752abc-4ab5-42f6-be69-b2ef0baa2d6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:33.987554 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-25752abc-4ab5-42f6-be69-b2ef0baa2d6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:34.222953 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-25752abc-4ab5-42f6-be69-b2ef0baa2d6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 27629 microversion: 2.1 time: 0.267069 Nov 11 20:41:34.223862 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 381/692] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:33 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 27629 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:34.305742 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-32fa5f03-f057-465f-8bb8-030f85dc865b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:34.318345 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-32fa5f03-f057-465f-8bb8-030f85dc865b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:34.321569 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-32fa5f03-f057-465f-8bb8-030f85dc865b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:34.322891 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-32fa5f03-f057-465f-8bb8-030f85dc865b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1739 microversion: 2.20 time: 0.415611 Nov 11 20:41:34.332206 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 312/693] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:33 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1739 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:34.598525 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-498112d0-edbc-4ace-b0c8-6bfe4fe4cbce tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:34.599798 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-498112d0-edbc-4ace-b0c8-6bfe4fe4cbce tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:34.610426 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-498112d0-edbc-4ace-b0c8-6bfe4fe4cbce tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:34.612291 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-498112d0-edbc-4ace-b0c8-6bfe4fe4cbce tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:34.613412 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-498112d0-edbc-4ace-b0c8-6bfe4fe4cbce tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:34.614060 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-498112d0-edbc-4ace-b0c8-6bfe4fe4cbce tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:34.648853 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-498112d0-edbc-4ace-b0c8-6bfe4fe4cbce tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054534 Nov 11 20:41:34.649754 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 382/694] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:41:34 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:41:34.839847 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-479b8a65-aa16-4c83-9ed6-64bc2f3641ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:34.841327 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-479b8a65-aa16-4c83-9ed6-64bc2f3641ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:34.851681 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-479b8a65-aa16-4c83-9ed6-64bc2f3641ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:34.852478 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-479b8a65-aa16-4c83-9ed6-64bc2f3641ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:34.854329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-479b8a65-aa16-4c83-9ed6-64bc2f3641ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:34.855237 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-479b8a65-aa16-4c83-9ed6-64bc2f3641ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:35.023351 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-479b8a65-aa16-4c83-9ed6-64bc2f3641ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:35.032401 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-479b8a65-aa16-4c83-9ed6-64bc2f3641ed tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.203544 Nov 11 20:41:35.033048 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 313/695] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:34 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:35.235258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-36821ead-2c0a-4404-88c3-54127335c500 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:35.236396 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-36821ead-2c0a-4404-88c3-54127335c500 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:35.250293 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-36821ead-2c0a-4404-88c3-54127335c500 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:35.251080 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-36821ead-2c0a-4404-88c3-54127335c500 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:35.251935 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-36821ead-2c0a-4404-88c3-54127335c500 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:35.252520 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-36821ead-2c0a-4404-88c3-54127335c500 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:35.345077 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-cbd07fa1-9196-45fa-a694-e8772da60a10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:35.345968 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-cbd07fa1-9196-45fa-a694-e8772da60a10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:35.354886 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cbd07fa1-9196-45fa-a694-e8772da60a10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:35.355338 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cbd07fa1-9196-45fa-a694-e8772da60a10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:35.356351 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cbd07fa1-9196-45fa-a694-e8772da60a10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:35.356960 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cbd07fa1-9196-45fa-a694-e8772da60a10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:35.457359 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-36821ead-2c0a-4404-88c3-54127335c500 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 27778 microversion: 2.1 time: 0.225522 Nov 11 20:41:35.464306 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 383/696] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:35 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 27778 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:35.511311 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cbd07fa1-9196-45fa-a694-e8772da60a10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:35.520189 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cbd07fa1-9196-45fa-a694-e8772da60a10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:35.522713 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cbd07fa1-9196-45fa-a694-e8772da60a10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:35.523873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-cbd07fa1-9196-45fa-a694-e8772da60a10 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1739 microversion: 2.20 time: 0.182773 Nov 11 20:41:35.524753 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 314/697] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:35 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:35.666996 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-45b54fe6-8e14-45e7-bf34-ecd83e0d012b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:35.673509 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-45b54fe6-8e14-45e7-bf34-ecd83e0d012b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:35.688051 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-45b54fe6-8e14-45e7-bf34-ecd83e0d012b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:35.688773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-45b54fe6-8e14-45e7-bf34-ecd83e0d012b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:35.689790 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-45b54fe6-8e14-45e7-bf34-ecd83e0d012b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:35.690628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-45b54fe6-8e14-45e7-bf34-ecd83e0d012b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:35.747497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-45b54fe6-8e14-45e7-bf34-ecd83e0d012b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090451 Nov 11 20:41:35.761710 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 384/698] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:41:35 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:41:36.051113 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-518b16c5-6381-41ad-be94-93ea116ee56a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:36.051910 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-518b16c5-6381-41ad-be94-93ea116ee56a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:36.062347 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-518b16c5-6381-41ad-be94-93ea116ee56a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:36.062912 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-518b16c5-6381-41ad-be94-93ea116ee56a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:36.063635 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-518b16c5-6381-41ad-be94-93ea116ee56a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:36.064114 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-518b16c5-6381-41ad-be94-93ea116ee56a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:36.258186 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-518b16c5-6381-41ad-be94-93ea116ee56a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:36.268362 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-518b16c5-6381-41ad-be94-93ea116ee56a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.221529 Nov 11 20:41:36.268931 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 315/699] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:36 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:36.471347 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b92308db-0f84-4352-8630-8207bc18f5bc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:36.473072 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b92308db-0f84-4352-8630-8207bc18f5bc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:36.479819 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b92308db-0f84-4352-8630-8207bc18f5bc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:36.484788 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b92308db-0f84-4352-8630-8207bc18f5bc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:36.485699 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b92308db-0f84-4352-8630-8207bc18f5bc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:36.486137 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b92308db-0f84-4352-8630-8207bc18f5bc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:36.546832 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0d16853e-9567-414e-879b-ce3bfd9210ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:36.548534 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0d16853e-9567-414e-879b-ce3bfd9210ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:36.558143 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d16853e-9567-414e-879b-ce3bfd9210ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:36.558615 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d16853e-9567-414e-879b-ce3bfd9210ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:36.559487 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d16853e-9567-414e-879b-ce3bfd9210ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:36.559933 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0d16853e-9567-414e-879b-ce3bfd9210ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:36.672920 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b92308db-0f84-4352-8630-8207bc18f5bc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 27999 microversion: 2.1 time: 0.205253 Nov 11 20:41:36.677907 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 385/700] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:36 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 27999 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:36.784820 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0d16853e-9567-414e-879b-ce3bfd9210ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:36.798938 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0d16853e-9567-414e-879b-ce3bfd9210ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:36.800425 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0d16853e-9567-414e-879b-ce3bfd9210ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:36.801600 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0d16853e-9567-414e-879b-ce3bfd9210ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1739 microversion: 2.20 time: 0.260851 Nov 11 20:41:36.804026 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 316/701] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:36 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:37.007583 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-76b46888-b77d-45ad-8e57-9389cb6f0ef3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:37.009308 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-76b46888-b77d-45ad-8e57-9389cb6f0ef3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:37.016542 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-76b46888-b77d-45ad-8e57-9389cb6f0ef3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:37.017259 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-76b46888-b77d-45ad-8e57-9389cb6f0ef3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:37.018392 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-76b46888-b77d-45ad-8e57-9389cb6f0ef3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:37.018846 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-76b46888-b77d-45ad-8e57-9389cb6f0ef3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:37.055665 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-76b46888-b77d-45ad-8e57-9389cb6f0ef3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Going to try to terminate instance {{(pid=122526) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:41:37.173001 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-76b46888-b77d-45ad-8e57-9389cb6f0ef3 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 204 len: 0 microversion: 2.1 time: 0.169549 Nov 11 20:41:37.175208 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 386/702] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:41:37 2021] DELETE /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:41:37.185358 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-00e6c0e9-94e3-4e69-ae07-80078ac690d0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:37.186013 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-00e6c0e9-94e3-4e69-ae07-80078ac690d0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:37.192869 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-00e6c0e9-94e3-4e69-ae07-80078ac690d0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:37.193520 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-00e6c0e9-94e3-4e69-ae07-80078ac690d0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:37.197263 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-00e6c0e9-94e3-4e69-ae07-80078ac690d0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:37.197896 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-00e6c0e9-94e3-4e69-ae07-80078ac690d0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:37.287053 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6ce5c796-fb95-4209-ad98-ddc5bc0b55bf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:37.288787 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6ce5c796-fb95-4209-ad98-ddc5bc0b55bf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:37.299612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6ce5c796-fb95-4209-ad98-ddc5bc0b55bf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:37.307336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6ce5c796-fb95-4209-ad98-ddc5bc0b55bf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:37.308462 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6ce5c796-fb95-4209-ad98-ddc5bc0b55bf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:37.309123 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6ce5c796-fb95-4209-ad98-ddc5bc0b55bf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:37.390401 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-00e6c0e9-94e3-4e69-ae07-80078ac690d0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:37.399133 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-00e6c0e9-94e3-4e69-ae07-80078ac690d0 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1513 microversion: 2.1 time: 0.219251 Nov 11 20:41:37.409776 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 317/703] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:37 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:37.517783 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6ce5c796-fb95-4209-ad98-ddc5bc0b55bf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:37.526474 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6ce5c796-fb95-4209-ad98-ddc5bc0b55bf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.243763 Nov 11 20:41:37.527599 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 387/704] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:37 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:37.691331 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3614e25f-edfc-4932-8f94-f544db9ae380 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:37.693020 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3614e25f-edfc-4932-8f94-f544db9ae380 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:37.702699 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3614e25f-edfc-4932-8f94-f544db9ae380 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:37.703151 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3614e25f-edfc-4932-8f94-f544db9ae380 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:37.704471 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3614e25f-edfc-4932-8f94-f544db9ae380 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:37.704911 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3614e25f-edfc-4932-8f94-f544db9ae380 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:37.822128 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e8502def-0c88-48a4-a68c-25aa362aaa58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:37.823071 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e8502def-0c88-48a4-a68c-25aa362aaa58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:37.833531 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8502def-0c88-48a4-a68c-25aa362aaa58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:37.835185 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8502def-0c88-48a4-a68c-25aa362aaa58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:37.835415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8502def-0c88-48a4-a68c-25aa362aaa58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:37.835823 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8502def-0c88-48a4-a68c-25aa362aaa58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:37.870350 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3614e25f-edfc-4932-8f94-f544db9ae380 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28081 microversion: 2.1 time: 0.182710 Nov 11 20:41:37.877006 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 318/705] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:37 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28081 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:38.017482 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e8502def-0c88-48a4-a68c-25aa362aaa58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:38.028079 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e8502def-0c88-48a4-a68c-25aa362aaa58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:38.029792 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e8502def-0c88-48a4-a68c-25aa362aaa58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:38.030942 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e8502def-0c88-48a4-a68c-25aa362aaa58 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1739 microversion: 2.20 time: 0.214580 Nov 11 20:41:38.031719 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 388/706] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:37 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:38.418280 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c92bc34a-c8d4-408b-bdd0-ffe4ccd2e614 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:38.419858 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c92bc34a-c8d4-408b-bdd0-ffe4ccd2e614 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:38.434299 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c92bc34a-c8d4-408b-bdd0-ffe4ccd2e614 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:38.438051 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c92bc34a-c8d4-408b-bdd0-ffe4ccd2e614 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:38.439130 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c92bc34a-c8d4-408b-bdd0-ffe4ccd2e614 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:38.440483 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c92bc34a-c8d4-408b-bdd0-ffe4ccd2e614 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:38.546734 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4288784a-cb46-4bcb-ade9-8141ad8b00e6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:38.547936 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4288784a-cb46-4bcb-ade9-8141ad8b00e6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:38.563594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4288784a-cb46-4bcb-ade9-8141ad8b00e6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:38.564887 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4288784a-cb46-4bcb-ade9-8141ad8b00e6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:38.577085 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4288784a-cb46-4bcb-ade9-8141ad8b00e6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:38.577804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4288784a-cb46-4bcb-ade9-8141ad8b00e6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:38.679896 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c92bc34a-c8d4-408b-bdd0-ffe4ccd2e614 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:38.688609 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c92bc34a-c8d4-408b-bdd0-ffe4ccd2e614 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1513 microversion: 2.1 time: 0.275635 Nov 11 20:41:38.707359 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 319/707] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:38 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:38.819127 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4288784a-cb46-4bcb-ade9-8141ad8b00e6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:38.828846 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4288784a-cb46-4bcb-ade9-8141ad8b00e6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.287955 Nov 11 20:41:38.830055 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 389/708] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:38 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:38.895635 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1e3ecc06-3704-45da-bf11-eef6d20bed86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:38.898506 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1e3ecc06-3704-45da-bf11-eef6d20bed86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:38.914705 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1e3ecc06-3704-45da-bf11-eef6d20bed86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:38.918634 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1e3ecc06-3704-45da-bf11-eef6d20bed86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:38.922354 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1e3ecc06-3704-45da-bf11-eef6d20bed86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:38.924628 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1e3ecc06-3704-45da-bf11-eef6d20bed86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:39.053918 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-07f738c3-cbca-4d77-8acb-59fb85c7c649 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:39.056532 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-07f738c3-cbca-4d77-8acb-59fb85c7c649 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:39.061976 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-07f738c3-cbca-4d77-8acb-59fb85c7c649 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:39.062592 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-07f738c3-cbca-4d77-8acb-59fb85c7c649 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:39.063595 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-07f738c3-cbca-4d77-8acb-59fb85c7c649 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:39.064145 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-07f738c3-cbca-4d77-8acb-59fb85c7c649 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:39.146016 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1e3ecc06-3704-45da-bf11-eef6d20bed86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28184 microversion: 2.1 time: 0.266586 Nov 11 20:41:39.149301 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 320/709] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:38 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28184 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:39.217770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-07f738c3-cbca-4d77-8acb-59fb85c7c649 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:39.229497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-07f738c3-cbca-4d77-8acb-59fb85c7c649 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:39.230992 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-07f738c3-cbca-4d77-8acb-59fb85c7c649 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:39.232197 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-07f738c3-cbca-4d77-8acb-59fb85c7c649 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1739 microversion: 2.20 time: 0.182833 Nov 11 20:41:39.233059 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 390/710] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:39 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:39.708510 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ad3e342f-d240-4097-a2a6-e2dac9cb76a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:39.708510 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ad3e342f-d240-4097-a2a6-e2dac9cb76a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:39.716252 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ad3e342f-d240-4097-a2a6-e2dac9cb76a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:39.717076 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ad3e342f-d240-4097-a2a6-e2dac9cb76a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:39.718161 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ad3e342f-d240-4097-a2a6-e2dac9cb76a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:39.718855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ad3e342f-d240-4097-a2a6-e2dac9cb76a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:39.847527 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fe5dc427-c234-458f-9d87-c1a9c298e8f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:39.849407 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fe5dc427-c234-458f-9d87-c1a9c298e8f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:39.858739 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fe5dc427-c234-458f-9d87-c1a9c298e8f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:39.861543 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fe5dc427-c234-458f-9d87-c1a9c298e8f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:39.863143 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fe5dc427-c234-458f-9d87-c1a9c298e8f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:39.865442 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fe5dc427-c234-458f-9d87-c1a9c298e8f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:39.914159 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ad3e342f-d240-4097-a2a6-e2dac9cb76a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:39.928108 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ad3e342f-d240-4097-a2a6-e2dac9cb76a1 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1513 microversion: 2.1 time: 0.225190 Nov 11 20:41:39.942356 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 321/711] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:39 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1513 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:40.061343 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fe5dc427-c234-458f-9d87-c1a9c298e8f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:40.072980 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fe5dc427-c234-458f-9d87-c1a9c298e8f1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.228138 Nov 11 20:41:40.073928 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 391/712] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:39 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:40.160136 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-282e30c3-3b7f-4154-bc41-4b4fbb53c153 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:40.161515 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-282e30c3-3b7f-4154-bc41-4b4fbb53c153 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:40.169976 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-282e30c3-3b7f-4154-bc41-4b4fbb53c153 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:40.170803 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-282e30c3-3b7f-4154-bc41-4b4fbb53c153 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:40.171939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-282e30c3-3b7f-4154-bc41-4b4fbb53c153 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:40.177179 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-282e30c3-3b7f-4154-bc41-4b4fbb53c153 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:40.254002 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e8287139-a563-4c08-b702-f3234b825eb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:40.255058 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e8287139-a563-4c08-b702-f3234b825eb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:40.266350 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8287139-a563-4c08-b702-f3234b825eb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:40.267175 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8287139-a563-4c08-b702-f3234b825eb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:40.270486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8287139-a563-4c08-b702-f3234b825eb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:40.272843 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8287139-a563-4c08-b702-f3234b825eb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:40.349058 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-282e30c3-3b7f-4154-bc41-4b4fbb53c153 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28230 microversion: 2.1 time: 0.192626 Nov 11 20:41:40.350140 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 322/713] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:40 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28230 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:40.544550 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e8287139-a563-4c08-b702-f3234b825eb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:40.565369 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e8287139-a563-4c08-b702-f3234b825eb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:40.566984 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e8287139-a563-4c08-b702-f3234b825eb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:40.568263 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e8287139-a563-4c08-b702-f3234b825eb6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1739 microversion: 2.20 time: 0.318356 Nov 11 20:41:40.570328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 392/714] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:40 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1739 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:40.951594 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a894d660-5a57-46a3-938a-dde25f13e243 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:40.954481 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a894d660-5a57-46a3-938a-dde25f13e243 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:40.968796 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a894d660-5a57-46a3-938a-dde25f13e243 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:40.969640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a894d660-5a57-46a3-938a-dde25f13e243 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:40.970707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a894d660-5a57-46a3-938a-dde25f13e243 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:40.971399 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a894d660-5a57-46a3-938a-dde25f13e243 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:41.092619 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-45103fea-2004-4632-89bc-8c6cbedf365b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:41.093522 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-45103fea-2004-4632-89bc-8c6cbedf365b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:41.108294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-45103fea-2004-4632-89bc-8c6cbedf365b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:41.108778 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-45103fea-2004-4632-89bc-8c6cbedf365b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:41.109645 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-45103fea-2004-4632-89bc-8c6cbedf365b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:41.110236 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-45103fea-2004-4632-89bc-8c6cbedf365b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:41.188761 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a894d660-5a57-46a3-938a-dde25f13e243 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:41.200583 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a894d660-5a57-46a3-938a-dde25f13e243 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1513 microversion: 2.1 time: 0.252977 Nov 11 20:41:41.206782 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 323/715] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:40 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:41.362924 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-06354360-998e-457d-b2fe-ffed1c402800 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:41.364446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-06354360-998e-457d-b2fe-ffed1c402800 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:41.379745 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-06354360-998e-457d-b2fe-ffed1c402800 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:41.380386 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-06354360-998e-457d-b2fe-ffed1c402800 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:41.385153 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-06354360-998e-457d-b2fe-ffed1c402800 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:41.388163 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-06354360-998e-457d-b2fe-ffed1c402800 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:41.396787 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-45103fea-2004-4632-89bc-8c6cbedf365b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:41.433968 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-45103fea-2004-4632-89bc-8c6cbedf365b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.345390 Nov 11 20:41:41.444838 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 393/716] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:41 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:41.590918 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3eee8cb2-0c6f-4ef3-a5b2-c527f4a1e20f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:41.592275 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3eee8cb2-0c6f-4ef3-a5b2-c527f4a1e20f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:41.600223 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3eee8cb2-0c6f-4ef3-a5b2-c527f4a1e20f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:41.600488 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3eee8cb2-0c6f-4ef3-a5b2-c527f4a1e20f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:41.601116 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3eee8cb2-0c6f-4ef3-a5b2-c527f4a1e20f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:41.601592 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3eee8cb2-0c6f-4ef3-a5b2-c527f4a1e20f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:41.674019 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-06354360-998e-457d-b2fe-ffed1c402800 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28373 microversion: 2.1 time: 0.315231 Nov 11 20:41:41.675222 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 324/717] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:41 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28373 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:41:41.805069 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3eee8cb2-0c6f-4ef3-a5b2-c527f4a1e20f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:41.817339 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3eee8cb2-0c6f-4ef3-a5b2-c527f4a1e20f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:41.820345 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3eee8cb2-0c6f-4ef3-a5b2-c527f4a1e20f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:41.821826 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3eee8cb2-0c6f-4ef3-a5b2-c527f4a1e20f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1739 microversion: 2.20 time: 0.236559 Nov 11 20:41:41.836041 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 394/718] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:41 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:42.223164 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-cffd64b3-8d25-4d6e-93f9-f62fe448ef7d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:42.223863 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-cffd64b3-8d25-4d6e-93f9-f62fe448ef7d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:42.232968 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cffd64b3-8d25-4d6e-93f9-f62fe448ef7d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:42.233413 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cffd64b3-8d25-4d6e-93f9-f62fe448ef7d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:42.234208 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cffd64b3-8d25-4d6e-93f9-f62fe448ef7d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:42.234640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cffd64b3-8d25-4d6e-93f9-f62fe448ef7d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:42.452807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e6db6a59-a1db-40e2-9af8-47240780f17d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:42.453441 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e6db6a59-a1db-40e2-9af8-47240780f17d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:42.467413 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e6db6a59-a1db-40e2-9af8-47240780f17d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:42.467674 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e6db6a59-a1db-40e2-9af8-47240780f17d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:42.468574 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e6db6a59-a1db-40e2-9af8-47240780f17d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:42.468956 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e6db6a59-a1db-40e2-9af8-47240780f17d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:43.029129 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cffd64b3-8d25-4d6e-93f9-f62fe448ef7d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:43.049802 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-cffd64b3-8d25-4d6e-93f9-f62fe448ef7d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1513 microversion: 2.1 time: 0.830732 Nov 11 20:41:43.050849 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 325/719] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:42 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1513 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:43.063749 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e4f74acd-90a8-4fdc-9de1-6a95c394dc4f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:43.065936 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e4f74acd-90a8-4fdc-9de1-6a95c394dc4f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:43.079728 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e4f74acd-90a8-4fdc-9de1-6a95c394dc4f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:43.080352 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e4f74acd-90a8-4fdc-9de1-6a95c394dc4f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:43.080993 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e4f74acd-90a8-4fdc-9de1-6a95c394dc4f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:43.081433 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e4f74acd-90a8-4fdc-9de1-6a95c394dc4f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:43.169000 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e6db6a59-a1db-40e2-9af8-47240780f17d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:43.185245 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e6db6a59-a1db-40e2-9af8-47240780f17d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.736051 Nov 11 20:41:43.186384 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 395/720] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:42 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:43.191169 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-aa783dd4-9aa0-4e2d-b614-e5069d079c95 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:43.192432 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-aa783dd4-9aa0-4e2d-b614-e5069d079c95 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:43.203552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aa783dd4-9aa0-4e2d-b614-e5069d079c95 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:43.204465 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aa783dd4-9aa0-4e2d-b614-e5069d079c95 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:43.205844 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aa783dd4-9aa0-4e2d-b614-e5069d079c95 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:43.206385 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aa783dd4-9aa0-4e2d-b614-e5069d079c95 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:43.255211 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e4f74acd-90a8-4fdc-9de1-6a95c394dc4f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28668 microversion: 2.1 time: 0.203248 Nov 11 20:41:43.256265 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 326/721] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:43 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28668 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:43.449635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-aa783dd4-9aa0-4e2d-b614-e5069d079c95 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:43.480056 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-aa783dd4-9aa0-4e2d-b614-e5069d079c95 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:43.482621 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 20:41:43.482912 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: Thu Nov 11 20:41:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 20:41:43.488341 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-aa783dd4-9aa0-4e2d-b614-e5069d079c95 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:43.489772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-aa783dd4-9aa0-4e2d-b614-e5069d079c95 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1739 microversion: 2.20 time: 0.302309 Nov 11 20:41:43.492651 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 396/722] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:43 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:43.682433 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-1593e211-3430-413a-99fb-97663f72b1cc req-95c8ae4d-70b2-452c-bfa3-3bbe939de3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3faaf4a3-b047-49f0-b57f-b7ad4a9ca681", "name": "network-vif-deleted", "tag": "4e0620dd-83bb-41b6-9d21-469aaf4c4d29"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:43.684316 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:41:43.684316 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:41:43.701155 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-1593e211-3430-413a-99fb-97663f72b1cc req-95c8ae4d-70b2-452c-bfa3-3bbe939de3c7 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:43.704125 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-1593e211-3430-413a-99fb-97663f72b1cc req-95c8ae4d-70b2-452c-bfa3-3bbe939de3c7 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:43.724295 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-1593e211-3430-413a-99fb-97663f72b1cc req-95c8ae4d-70b2-452c-bfa3-3bbe939de3c7 service nova] Creating event network-vif-deleted:4e0620dd-83bb-41b6-9d21-469aaf4c4d29 for instance 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 on hv-cinder-81764 Nov 11 20:41:43.739522 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-1593e211-3430-413a-99fb-97663f72b1cc req-95c8ae4d-70b2-452c-bfa3-3bbe939de3c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061696 Nov 11 20:41:43.743895 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 327/723] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:41:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:41:44.066842 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f6b2cb05-2646-4cd7-94ab-2e6515e0aa80 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:44.070788 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f6b2cb05-2646-4cd7-94ab-2e6515e0aa80 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:44.076943 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6b2cb05-2646-4cd7-94ab-2e6515e0aa80 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:44.077456 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6b2cb05-2646-4cd7-94ab-2e6515e0aa80 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:44.078305 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6b2cb05-2646-4cd7-94ab-2e6515e0aa80 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:44.078964 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6b2cb05-2646-4cd7-94ab-2e6515e0aa80 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:44.115427 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6b2cb05-2646-4cd7-94ab-2e6515e0aa80 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:44.116536 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6b2cb05-2646-4cd7-94ab-2e6515e0aa80 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:44.117069 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-f6b2cb05-2646-4cd7-94ab-2e6515e0aa80 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lazy-loading 'fault' on Instance uuid 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:41:44.162292 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f6b2cb05-2646-4cd7-94ab-2e6515e0aa80 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:44.171645 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f6b2cb05-2646-4cd7-94ab-2e6515e0aa80 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1308 microversion: 2.1 time: 0.108301 Nov 11 20:41:44.172478 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 397/724] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:44 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:44.204948 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9aa89598-da81-41cf-b8e8-57af9fefcf08 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:44.205542 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9aa89598-da81-41cf-b8e8-57af9fefcf08 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:44.212433 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9aa89598-da81-41cf-b8e8-57af9fefcf08 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:44.213011 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9aa89598-da81-41cf-b8e8-57af9fefcf08 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:44.213795 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9aa89598-da81-41cf-b8e8-57af9fefcf08 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:44.214231 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9aa89598-da81-41cf-b8e8-57af9fefcf08 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:44.267022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8b025354-291e-42e9-a90d-117d8bab87e7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:44.268100 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8b025354-291e-42e9-a90d-117d8bab87e7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:44.275093 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8b025354-291e-42e9-a90d-117d8bab87e7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:44.275617 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8b025354-291e-42e9-a90d-117d8bab87e7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:44.276553 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8b025354-291e-42e9-a90d-117d8bab87e7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:44.277103 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8b025354-291e-42e9-a90d-117d8bab87e7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:44.361164 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9aa89598-da81-41cf-b8e8-57af9fefcf08 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:44.368505 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9aa89598-da81-41cf-b8e8-57af9fefcf08 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.169223 Nov 11 20:41:44.369062 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 328/725] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:44 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:44.446767 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8b025354-291e-42e9-a90d-117d8bab87e7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28787 microversion: 2.1 time: 0.183676 Nov 11 20:41:44.447524 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 398/726] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:44 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28787 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:44.511008 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ce382d9d-ba5e-433e-b1b5-4caa4797a909 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:44.511603 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ce382d9d-ba5e-433e-b1b5-4caa4797a909 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:44.518012 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce382d9d-ba5e-433e-b1b5-4caa4797a909 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:44.518645 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce382d9d-ba5e-433e-b1b5-4caa4797a909 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:44.519564 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce382d9d-ba5e-433e-b1b5-4caa4797a909 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:44.520174 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce382d9d-ba5e-433e-b1b5-4caa4797a909 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:44.660694 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ce382d9d-ba5e-433e-b1b5-4caa4797a909 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:44.669776 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ce382d9d-ba5e-433e-b1b5-4caa4797a909 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:44.671808 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ce382d9d-ba5e-433e-b1b5-4caa4797a909 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:44.673210 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ce382d9d-ba5e-433e-b1b5-4caa4797a909 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1739 microversion: 2.20 time: 0.166434 Nov 11 20:41:44.673763 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 329/727] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:44 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:45.190264 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1a65dbf2-c1a8-432a-8ae3-c7c16349e51e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:45.190974 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1a65dbf2-c1a8-432a-8ae3-c7c16349e51e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:45.198193 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1a65dbf2-c1a8-432a-8ae3-c7c16349e51e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:45.198645 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1a65dbf2-c1a8-432a-8ae3-c7c16349e51e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:45.199448 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1a65dbf2-c1a8-432a-8ae3-c7c16349e51e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:45.199870 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1a65dbf2-c1a8-432a-8ae3-c7c16349e51e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:45.233171 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1a65dbf2-c1a8-432a-8ae3-c7c16349e51e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:45.233727 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1a65dbf2-c1a8-432a-8ae3-c7c16349e51e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:45.234210 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-1a65dbf2-c1a8-432a-8ae3-c7c16349e51e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lazy-loading 'fault' on Instance uuid 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:41:45.279532 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1a65dbf2-c1a8-432a-8ae3-c7c16349e51e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:45.289291 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1a65dbf2-c1a8-432a-8ae3-c7c16349e51e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 200 len: 1308 microversion: 2.1 time: 0.103111 Nov 11 20:41:45.290434 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 399/728] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:45 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:45.385310 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-007aeaa6-d5eb-4c6f-9ec8-3aaae765b3b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:45.386682 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-007aeaa6-d5eb-4c6f-9ec8-3aaae765b3b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:45.393182 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-007aeaa6-d5eb-4c6f-9ec8-3aaae765b3b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:45.393708 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-007aeaa6-d5eb-4c6f-9ec8-3aaae765b3b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:45.394617 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-007aeaa6-d5eb-4c6f-9ec8-3aaae765b3b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:45.395088 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-007aeaa6-d5eb-4c6f-9ec8-3aaae765b3b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:45.459916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-035e6555-45cf-4ca5-a839-e4fb8615b665 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:45.461483 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-035e6555-45cf-4ca5-a839-e4fb8615b665 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:45.469648 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-035e6555-45cf-4ca5-a839-e4fb8615b665 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:45.470331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-035e6555-45cf-4ca5-a839-e4fb8615b665 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:45.471315 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-035e6555-45cf-4ca5-a839-e4fb8615b665 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:45.471751 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-035e6555-45cf-4ca5-a839-e4fb8615b665 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:45.540265 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-007aeaa6-d5eb-4c6f-9ec8-3aaae765b3b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:45.547962 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-007aeaa6-d5eb-4c6f-9ec8-3aaae765b3b5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.166388 Nov 11 20:41:45.548549 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 330/729] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:45 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:45.690474 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-72a7b50a-4387-433e-8043-fb2d38af2fee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:45.691049 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-72a7b50a-4387-433e-8043-fb2d38af2fee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:45.697904 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-72a7b50a-4387-433e-8043-fb2d38af2fee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:45.698350 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-72a7b50a-4387-433e-8043-fb2d38af2fee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:45.699124 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-72a7b50a-4387-433e-8043-fb2d38af2fee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:45.699577 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-72a7b50a-4387-433e-8043-fb2d38af2fee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:45.853815 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-72a7b50a-4387-433e-8043-fb2d38af2fee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:45.862244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-72a7b50a-4387-433e-8043-fb2d38af2fee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:45.863753 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-72a7b50a-4387-433e-8043-fb2d38af2fee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:45.864967 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-72a7b50a-4387-433e-8043-fb2d38af2fee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1721 microversion: 2.20 time: 0.178207 Nov 11 20:41:45.865600 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 331/730] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:45 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:46.307933 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1a21d423-40ea-4547-a765-073872ea7b7a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:46.308625 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1a21d423-40ea-4547-a765-073872ea7b7a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:46.315290 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1a21d423-40ea-4547-a765-073872ea7b7a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:46.315946 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1a21d423-40ea-4547-a765-073872ea7b7a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:46.316758 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1a21d423-40ea-4547-a765-073872ea7b7a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:46.317201 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1a21d423-40ea-4547-a765-073872ea7b7a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:46.332446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-1a21d423-40ea-4547-a765-073872ea7b7a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] HTTP exception thrown: Instance 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 could not be found. Nov 11 20:41:46.333368 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1a21d423-40ea-4547-a765-073872ea7b7a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Returning 404 to user: Instance 3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:41:46.334313 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1a21d423-40ea-4547-a765-073872ea7b7a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681" status: 404 len: 111 microversion: 2.1 time: 0.031462 Nov 11 20:41:46.334983 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 332/731] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:46 2021] GET /compute/v2.1/servers/3faaf4a3-b047-49f0-b57f-b7ad4a9ca681 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 11 20:41:46.565598 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f7feb84e-8e96-45b5-9c6f-466eb3501f9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:46.566254 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f7feb84e-8e96-45b5-9c6f-466eb3501f9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:46.572939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f7feb84e-8e96-45b5-9c6f-466eb3501f9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:46.573421 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f7feb84e-8e96-45b5-9c6f-466eb3501f9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:46.574187 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f7feb84e-8e96-45b5-9c6f-466eb3501f9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:46.574619 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f7feb84e-8e96-45b5-9c6f-466eb3501f9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:46.710388 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f7feb84e-8e96-45b5-9c6f-466eb3501f9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:46.718100 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f7feb84e-8e96-45b5-9c6f-466eb3501f9d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.156360 Nov 11 20:41:46.718662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 333/732] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:46 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:46.883453 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e4861624-ca5c-4b25-8e57-55abf1433e24 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:46.884100 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e4861624-ca5c-4b25-8e57-55abf1433e24 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:46.889850 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e4861624-ca5c-4b25-8e57-55abf1433e24 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:46.890291 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e4861624-ca5c-4b25-8e57-55abf1433e24 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:46.891050 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e4861624-ca5c-4b25-8e57-55abf1433e24 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:46.891477 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e4861624-ca5c-4b25-8e57-55abf1433e24 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:47.021245 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e4861624-ca5c-4b25-8e57-55abf1433e24 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:47.028949 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e4861624-ca5c-4b25-8e57-55abf1433e24 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:47.030514 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e4861624-ca5c-4b25-8e57-55abf1433e24 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:47.031712 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e4861624-ca5c-4b25-8e57-55abf1433e24 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1721 microversion: 2.20 time: 0.151925 Nov 11 20:41:47.032305 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 334/733] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:46 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:47.474620 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-035e6555-45cf-4ca5-a839-e4fb8615b665 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28787 microversion: 2.1 time: 2.019736 Nov 11 20:41:47.476433 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 400/734] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:45 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28787 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:41:47.735348 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a71f4781-9f63-4adc-ad7b-bedc35b4c0a7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:47.736596 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a71f4781-9f63-4adc-ad7b-bedc35b4c0a7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:47.745178 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a71f4781-9f63-4adc-ad7b-bedc35b4c0a7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:47.745628 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a71f4781-9f63-4adc-ad7b-bedc35b4c0a7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:47.746413 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a71f4781-9f63-4adc-ad7b-bedc35b4c0a7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:47.747106 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a71f4781-9f63-4adc-ad7b-bedc35b4c0a7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:47.892709 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a71f4781-9f63-4adc-ad7b-bedc35b4c0a7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:47.900823 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a71f4781-9f63-4adc-ad7b-bedc35b4c0a7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.169958 Nov 11 20:41:47.901407 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 335/735] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:47 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:48.051232 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3bb2d7fb-c790-47be-8769-77dbb399525b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:48.051911 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3bb2d7fb-c790-47be-8769-77dbb399525b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:48.059881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3bb2d7fb-c790-47be-8769-77dbb399525b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:48.060355 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3bb2d7fb-c790-47be-8769-77dbb399525b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:48.061159 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3bb2d7fb-c790-47be-8769-77dbb399525b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:48.061587 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3bb2d7fb-c790-47be-8769-77dbb399525b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:48.200106 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3bb2d7fb-c790-47be-8769-77dbb399525b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:48.208158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3bb2d7fb-c790-47be-8769-77dbb399525b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:48.210147 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3bb2d7fb-c790-47be-8769-77dbb399525b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:48.212038 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3bb2d7fb-c790-47be-8769-77dbb399525b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1721 microversion: 2.20 time: 0.164877 Nov 11 20:41:48.212607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 401/736] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:48 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:48.487154 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c9e49d83-5521-411b-ac10-fc4073c44e66 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:48.488186 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c9e49d83-5521-411b-ac10-fc4073c44e66 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:48.495030 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c9e49d83-5521-411b-ac10-fc4073c44e66 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:48.495510 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c9e49d83-5521-411b-ac10-fc4073c44e66 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:48.496320 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c9e49d83-5521-411b-ac10-fc4073c44e66 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:48.496756 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c9e49d83-5521-411b-ac10-fc4073c44e66 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:48.685296 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c9e49d83-5521-411b-ac10-fc4073c44e66 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28787 microversion: 2.1 time: 0.201657 Nov 11 20:41:48.686232 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 336/737] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:48 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28787 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:48.919788 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ebe23389-2a13-40c5-8f02-49ad06491d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:48.920505 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ebe23389-2a13-40c5-8f02-49ad06491d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:48.927001 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ebe23389-2a13-40c5-8f02-49ad06491d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:48.927447 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ebe23389-2a13-40c5-8f02-49ad06491d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:48.928251 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ebe23389-2a13-40c5-8f02-49ad06491d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:48.928774 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ebe23389-2a13-40c5-8f02-49ad06491d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:49.122065 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ebe23389-2a13-40c5-8f02-49ad06491d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:49.130239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ebe23389-2a13-40c5-8f02-49ad06491d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.214144 Nov 11 20:41:49.130865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 402/738] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:48 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:49.231082 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-16c6635c-4dbb-4d9a-9397-2aae055e1b7b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:49.231799 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-16c6635c-4dbb-4d9a-9397-2aae055e1b7b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:49.238874 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-16c6635c-4dbb-4d9a-9397-2aae055e1b7b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:49.239315 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-16c6635c-4dbb-4d9a-9397-2aae055e1b7b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:49.240115 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-16c6635c-4dbb-4d9a-9397-2aae055e1b7b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:49.240610 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-16c6635c-4dbb-4d9a-9397-2aae055e1b7b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:49.538640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-16c6635c-4dbb-4d9a-9397-2aae055e1b7b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:49.538640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-16c6635c-4dbb-4d9a-9397-2aae055e1b7b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:49.538966 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-16c6635c-4dbb-4d9a-9397-2aae055e1b7b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:49.538966 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-16c6635c-4dbb-4d9a-9397-2aae055e1b7b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1721 microversion: 2.20 time: 0.207746 Nov 11 20:41:49.538966 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 337/739] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:49 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:49.697809 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e7784c17-fbab-4bc0-8330-fe7cfbf92cdb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:49.699234 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e7784c17-fbab-4bc0-8330-fe7cfbf92cdb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:49.707559 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e7784c17-fbab-4bc0-8330-fe7cfbf92cdb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:49.708025 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e7784c17-fbab-4bc0-8330-fe7cfbf92cdb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:49.708810 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e7784c17-fbab-4bc0-8330-fe7cfbf92cdb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:49.709237 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e7784c17-fbab-4bc0-8330-fe7cfbf92cdb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:49.811059 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e7784c17-fbab-4bc0-8330-fe7cfbf92cdb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28787 microversion: 2.1 time: 0.117718 Nov 11 20:41:49.811677 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 403/740] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:49 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28787 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:50.151427 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-38919b11-1221-40c7-9706-ff154921d990 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:50.151427 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-38919b11-1221-40c7-9706-ff154921d990 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:50.155095 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-38919b11-1221-40c7-9706-ff154921d990 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:50.155565 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-38919b11-1221-40c7-9706-ff154921d990 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:50.156389 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-38919b11-1221-40c7-9706-ff154921d990 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:50.156826 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-38919b11-1221-40c7-9706-ff154921d990 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:50.304871 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-38919b11-1221-40c7-9706-ff154921d990 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:50.312783 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-38919b11-1221-40c7-9706-ff154921d990 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.168858 Nov 11 20:41:50.313350 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 338/741] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:50 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:50.454253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-01f059cf-0536-4ee7-b682-c8a3802b1422 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:50.455196 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-01f059cf-0536-4ee7-b682-c8a3802b1422 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:50.462736 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-01f059cf-0536-4ee7-b682-c8a3802b1422 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:50.463184 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-01f059cf-0536-4ee7-b682-c8a3802b1422 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:50.464007 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-01f059cf-0536-4ee7-b682-c8a3802b1422 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:50.464587 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-01f059cf-0536-4ee7-b682-c8a3802b1422 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:50.618159 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d4ed8bd7-e520-484d-bf12-b8c79fe28c5c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:50.618852 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d4ed8bd7-e520-484d-bf12-b8c79fe28c5c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:50.624648 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-01f059cf-0536-4ee7-b682-c8a3802b1422 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:50.628268 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d4ed8bd7-e520-484d-bf12-b8c79fe28c5c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:50.628942 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d4ed8bd7-e520-484d-bf12-b8c79fe28c5c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:50.630254 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d4ed8bd7-e520-484d-bf12-b8c79fe28c5c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:50.630959 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d4ed8bd7-e520-484d-bf12-b8c79fe28c5c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:50.632886 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-01f059cf-0536-4ee7-b682-c8a3802b1422 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:50.634525 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-01f059cf-0536-4ee7-b682-c8a3802b1422 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:50.636214 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-01f059cf-0536-4ee7-b682-c8a3802b1422 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1721 microversion: 2.20 time: 0.186105 Nov 11 20:41:50.638729 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 404/742] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:50 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:50.674438 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d4ed8bd7-e520-484d-bf12-b8c79fe28c5c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Going to try to terminate instance {{(pid=122527) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:41:50.764995 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d4ed8bd7-e520-484d-bf12-b8c79fe28c5c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 204 len: 0 microversion: 2.1 time: 0.150495 Nov 11 20:41:50.766086 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 339/743] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:41:50 2021] DELETE /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 11 20:41:50.777915 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3d92ae65-5513-46c7-99d6-deced921a569 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:50.779010 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3d92ae65-5513-46c7-99d6-deced921a569 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:50.786976 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3d92ae65-5513-46c7-99d6-deced921a569 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:50.787533 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3d92ae65-5513-46c7-99d6-deced921a569 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:50.789239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3d92ae65-5513-46c7-99d6-deced921a569 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:50.789935 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3d92ae65-5513-46c7-99d6-deced921a569 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:50.825541 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-20325e2b-18ae-4b9c-95a0-1ef10f7e4a6f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:50.826656 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-20325e2b-18ae-4b9c-95a0-1ef10f7e4a6f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:50.833665 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-20325e2b-18ae-4b9c-95a0-1ef10f7e4a6f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:50.834258 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-20325e2b-18ae-4b9c-95a0-1ef10f7e4a6f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:50.835785 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-20325e2b-18ae-4b9c-95a0-1ef10f7e4a6f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:50.837080 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-20325e2b-18ae-4b9c-95a0-1ef10f7e4a6f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:50.939509 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3d92ae65-5513-46c7-99d6-deced921a569 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:50.953971 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3d92ae65-5513-46c7-99d6-deced921a569 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1514 microversion: 2.1 time: 0.182976 Nov 11 20:41:50.954807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 405/744] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:50 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:51.329849 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2f713fd7-ac4f-45b3-82fd-538062c55866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:51.330449 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2f713fd7-ac4f-45b3-82fd-538062c55866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:51.337680 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2f713fd7-ac4f-45b3-82fd-538062c55866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:51.338128 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2f713fd7-ac4f-45b3-82fd-538062c55866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:51.338934 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2f713fd7-ac4f-45b3-82fd-538062c55866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:51.339365 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2f713fd7-ac4f-45b3-82fd-538062c55866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:51.471225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2f713fd7-ac4f-45b3-82fd-538062c55866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:51.478994 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2f713fd7-ac4f-45b3-82fd-538062c55866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.153054 Nov 11 20:41:51.479552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 406/745] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:51 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:51.654469 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-106a9890-ef8d-4a32-ac17-1f4a6963993d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:51.655061 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-106a9890-ef8d-4a32-ac17-1f4a6963993d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:51.661446 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-106a9890-ef8d-4a32-ac17-1f4a6963993d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:51.661887 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-106a9890-ef8d-4a32-ac17-1f4a6963993d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:51.662649 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-106a9890-ef8d-4a32-ac17-1f4a6963993d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:51.663706 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-106a9890-ef8d-4a32-ac17-1f4a6963993d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:51.799325 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-106a9890-ef8d-4a32-ac17-1f4a6963993d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:51.807325 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-106a9890-ef8d-4a32-ac17-1f4a6963993d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:51.808825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-106a9890-ef8d-4a32-ac17-1f4a6963993d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:51.809972 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-106a9890-ef8d-4a32-ac17-1f4a6963993d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1721 microversion: 2.20 time: 0.159186 Nov 11 20:41:51.810537 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 407/746] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:51 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:51.971664 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-482a0246-a534-4fb5-a790-9a7bb817467b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:51.972301 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-482a0246-a534-4fb5-a790-9a7bb817467b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:51.978652 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-482a0246-a534-4fb5-a790-9a7bb817467b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:51.979105 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-482a0246-a534-4fb5-a790-9a7bb817467b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:51.979876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-482a0246-a534-4fb5-a790-9a7bb817467b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:51.980334 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-482a0246-a534-4fb5-a790-9a7bb817467b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:52.112341 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-482a0246-a534-4fb5-a790-9a7bb817467b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:52.120435 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-482a0246-a534-4fb5-a790-9a7bb817467b tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1514 microversion: 2.1 time: 0.152340 Nov 11 20:41:52.121003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 408/747] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:51 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:52.496204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f180e1ca-18bb-491f-8bea-0a04f7682696 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:52.496868 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f180e1ca-18bb-491f-8bea-0a04f7682696 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:52.502638 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f180e1ca-18bb-491f-8bea-0a04f7682696 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:52.503084 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f180e1ca-18bb-491f-8bea-0a04f7682696 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:52.503855 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f180e1ca-18bb-491f-8bea-0a04f7682696 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:52.504313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f180e1ca-18bb-491f-8bea-0a04f7682696 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:52.634206 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f180e1ca-18bb-491f-8bea-0a04f7682696 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:52.641852 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f180e1ca-18bb-491f-8bea-0a04f7682696 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.149264 Nov 11 20:41:52.642412 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 409/748] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:52 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:52.828598 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f7008f92-921f-41d6-a26a-ef26eb7c97ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:52.829198 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f7008f92-921f-41d6-a26a-ef26eb7c97ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:52.835750 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f7008f92-921f-41d6-a26a-ef26eb7c97ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:52.836227 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f7008f92-921f-41d6-a26a-ef26eb7c97ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:52.836991 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f7008f92-921f-41d6-a26a-ef26eb7c97ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:52.837438 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f7008f92-921f-41d6-a26a-ef26eb7c97ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:52.966402 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f7008f92-921f-41d6-a26a-ef26eb7c97ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:52.974199 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f7008f92-921f-41d6-a26a-ef26eb7c97ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:52.976796 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f7008f92-921f-41d6-a26a-ef26eb7c97ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:52.978043 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f7008f92-921f-41d6-a26a-ef26eb7c97ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1721 microversion: 2.20 time: 0.153120 Nov 11 20:41:52.978612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 410/749] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:52 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:53.137006 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-de60c687-0402-4563-9aa7-a0369defdb11 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:53.137526 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-de60c687-0402-4563-9aa7-a0369defdb11 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:53.143695 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-de60c687-0402-4563-9aa7-a0369defdb11 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:53.144182 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-de60c687-0402-4563-9aa7-a0369defdb11 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:53.144953 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-de60c687-0402-4563-9aa7-a0369defdb11 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:53.145382 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-de60c687-0402-4563-9aa7-a0369defdb11 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:53.276335 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-de60c687-0402-4563-9aa7-a0369defdb11 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:53.283854 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-de60c687-0402-4563-9aa7-a0369defdb11 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1514 microversion: 2.1 time: 0.150642 Nov 11 20:41:53.284440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 411/750] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:53 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:53.658201 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-66ec6a4a-cbee-408a-82c6-ddce7f6665d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:53.658881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-66ec6a4a-cbee-408a-82c6-ddce7f6665d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:53.665595 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-66ec6a4a-cbee-408a-82c6-ddce7f6665d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:53.666040 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-66ec6a4a-cbee-408a-82c6-ddce7f6665d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:53.666818 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-66ec6a4a-cbee-408a-82c6-ddce7f6665d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:53.667250 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-66ec6a4a-cbee-408a-82c6-ddce7f6665d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:53.800763 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-66ec6a4a-cbee-408a-82c6-ddce7f6665d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:53.808406 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-66ec6a4a-cbee-408a-82c6-ddce7f6665d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.153809 Nov 11 20:41:53.808963 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 412/751] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:53 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:53.996147 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9e99fe55-a7be-4b24-9713-13bdb2083968 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:53.996988 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9e99fe55-a7be-4b24-9713-13bdb2083968 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:54.004278 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9e99fe55-a7be-4b24-9713-13bdb2083968 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:54.004625 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9e99fe55-a7be-4b24-9713-13bdb2083968 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:54.005191 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-20325e2b-18ae-4b9c-95a0-1ef10f7e4a6f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28787 microversion: 2.1 time: 3.185193 Nov 11 20:41:54.005655 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9e99fe55-a7be-4b24-9713-13bdb2083968 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:54.009674 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9e99fe55-a7be-4b24-9713-13bdb2083968 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:54.009832 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 340/752] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:50 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28787 bytes in 3188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:41:54.124302 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-36c705a4-2dc0-4828-8dfd-2072f8002872 req-2008f953-765e-4932-85df-8aa5114943bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4a9f51-80d0-4901-beaf-9b03435f002c", "name": "network-vif-unplugged", "status": "completed", "tag": "bc0e19f0-bdca-4923-a0c3-77ad0c202bdc"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:54.125955 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:41:54.125955 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:41:54.134638 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-36c705a4-2dc0-4828-8dfd-2072f8002872 req-2008f953-765e-4932-85df-8aa5114943bd service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:54.135079 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-36c705a4-2dc0-4828-8dfd-2072f8002872 req-2008f953-765e-4932-85df-8aa5114943bd service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:54.149751 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-36c705a4-2dc0-4828-8dfd-2072f8002872 req-2008f953-765e-4932-85df-8aa5114943bd service nova] Creating event network-vif-unplugged:bc0e19f0-bdca-4923-a0c3-77ad0c202bdc for instance ce4a9f51-80d0-4901-beaf-9b03435f002c on hv-cinder-81764 Nov 11 20:41:54.150533 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9e99fe55-a7be-4b24-9713-13bdb2083968 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:54.156420 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-36c705a4-2dc0-4828-8dfd-2072f8002872 req-2008f953-765e-4932-85df-8aa5114943bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043197 Nov 11 20:41:54.157422 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 341/753] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:41:54 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:41:54.159244 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9e99fe55-a7be-4b24-9713-13bdb2083968 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:54.161151 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9e99fe55-a7be-4b24-9713-13bdb2083968 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:54.162848 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9e99fe55-a7be-4b24-9713-13bdb2083968 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1721 microversion: 2.20 time: 0.170039 Nov 11 20:41:54.164243 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 413/754] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:53 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:54.301994 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-72b8f60d-73cf-495c-a82b-8af03262fd6e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:54.302691 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-72b8f60d-73cf-495c-a82b-8af03262fd6e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:54.310089 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-72b8f60d-73cf-495c-a82b-8af03262fd6e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:54.310535 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-72b8f60d-73cf-495c-a82b-8af03262fd6e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:54.311312 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-72b8f60d-73cf-495c-a82b-8af03262fd6e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:54.311745 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-72b8f60d-73cf-495c-a82b-8af03262fd6e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:54.449991 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-72b8f60d-73cf-495c-a82b-8af03262fd6e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:54.457460 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-72b8f60d-73cf-495c-a82b-8af03262fd6e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1514 microversion: 2.1 time: 0.160053 Nov 11 20:41:54.458023 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 342/755] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:54 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:54.824931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f69aea78-7fcc-4f2c-a739-8600453ec6b9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:54.825505 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f69aea78-7fcc-4f2c-a739-8600453ec6b9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:54.831492 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f69aea78-7fcc-4f2c-a739-8600453ec6b9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:54.831931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f69aea78-7fcc-4f2c-a739-8600453ec6b9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:54.832740 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f69aea78-7fcc-4f2c-a739-8600453ec6b9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:54.833174 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f69aea78-7fcc-4f2c-a739-8600453ec6b9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:54.964980 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f69aea78-7fcc-4f2c-a739-8600453ec6b9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:54.972747 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f69aea78-7fcc-4f2c-a739-8600453ec6b9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.151498 Nov 11 20:41:54.973314 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 414/756] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:54 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:55.017235 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-568b370d-0436-4397-88e4-5fc98538611e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:55.018204 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-568b370d-0436-4397-88e4-5fc98538611e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:55.025900 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-568b370d-0436-4397-88e4-5fc98538611e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:55.026352 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-568b370d-0436-4397-88e4-5fc98538611e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:55.027134 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-568b370d-0436-4397-88e4-5fc98538611e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:55.027565 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-568b370d-0436-4397-88e4-5fc98538611e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:55.126890 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-568b370d-0436-4397-88e4-5fc98538611e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28787 microversion: 2.1 time: 0.113116 Nov 11 20:41:55.127456 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 343/757] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:55 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28787 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:55.180789 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e3963962-3243-4b08-b4d0-2a595ca9b599 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:55.181489 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e3963962-3243-4b08-b4d0-2a595ca9b599 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:55.187693 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3963962-3243-4b08-b4d0-2a595ca9b599 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:55.188245 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3963962-3243-4b08-b4d0-2a595ca9b599 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:55.189083 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3963962-3243-4b08-b4d0-2a595ca9b599 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:55.189514 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3963962-3243-4b08-b4d0-2a595ca9b599 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:55.333130 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e3963962-3243-4b08-b4d0-2a595ca9b599 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:55.342049 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e3963962-3243-4b08-b4d0-2a595ca9b599 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:55.343688 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e3963962-3243-4b08-b4d0-2a595ca9b599 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:55.345189 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e3963962-3243-4b08-b4d0-2a595ca9b599 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1721 microversion: 2.20 time: 0.168101 Nov 11 20:41:55.346072 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 415/758] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:55 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:55.476834 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-be22ef7f-a9b2-4be8-967f-e4a47b7ba83a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:55.478016 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-be22ef7f-a9b2-4be8-967f-e4a47b7ba83a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:55.487605 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be22ef7f-a9b2-4be8-967f-e4a47b7ba83a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:55.492707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be22ef7f-a9b2-4be8-967f-e4a47b7ba83a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:55.500202 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be22ef7f-a9b2-4be8-967f-e4a47b7ba83a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:55.500629 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-be22ef7f-a9b2-4be8-967f-e4a47b7ba83a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:55.922278 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-be22ef7f-a9b2-4be8-967f-e4a47b7ba83a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:55.932666 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-be22ef7f-a9b2-4be8-967f-e4a47b7ba83a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1514 microversion: 2.1 time: 0.460336 Nov 11 20:41:55.933223 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 344/759] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:55 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1514 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:55.990304 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fbfd7a52-b2a3-4b81-be40-34382f444807 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:55.990925 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fbfd7a52-b2a3-4b81-be40-34382f444807 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:55.997328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbfd7a52-b2a3-4b81-be40-34382f444807 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:55.997770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbfd7a52-b2a3-4b81-be40-34382f444807 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:55.998619 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbfd7a52-b2a3-4b81-be40-34382f444807 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:55.999470 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbfd7a52-b2a3-4b81-be40-34382f444807 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:56.138841 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-20fc9443-af8e-4414-9461-5ec20239154f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:56.139808 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fbfd7a52-b2a3-4b81-be40-34382f444807 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:56.139935 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-20fc9443-af8e-4414-9461-5ec20239154f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:56.147891 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-20fc9443-af8e-4414-9461-5ec20239154f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:56.148959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fbfd7a52-b2a3-4b81-be40-34382f444807 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.162116 Nov 11 20:41:56.149086 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-20fc9443-af8e-4414-9461-5ec20239154f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:56.149675 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 416/760] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:55 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:56.149875 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-20fc9443-af8e-4414-9461-5ec20239154f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:56.150470 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-20fc9443-af8e-4414-9461-5ec20239154f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:56.369107 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1bd85b6a-5107-4d0d-b4fc-8cb40ca62388 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:56.369702 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1bd85b6a-5107-4d0d-b4fc-8cb40ca62388 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:56.375820 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1bd85b6a-5107-4d0d-b4fc-8cb40ca62388 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:56.376294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1bd85b6a-5107-4d0d-b4fc-8cb40ca62388 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:56.377072 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1bd85b6a-5107-4d0d-b4fc-8cb40ca62388 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:56.377497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1bd85b6a-5107-4d0d-b4fc-8cb40ca62388 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:56.515266 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1bd85b6a-5107-4d0d-b4fc-8cb40ca62388 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:56.525851 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1bd85b6a-5107-4d0d-b4fc-8cb40ca62388 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:56.527521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1bd85b6a-5107-4d0d-b4fc-8cb40ca62388 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:56.529536 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1bd85b6a-5107-4d0d-b4fc-8cb40ca62388 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1724 microversion: 2.20 time: 0.164238 Nov 11 20:41:56.530641 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 417/761] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:56 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:56.547187 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c6d104d7-dc84-457d-8343-7c34b50fd3c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ece245e-e030-4b73-89f9-88bc4fe301d0"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:56.548310 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c6d104d7-dc84-457d-8343-7c34b50fd3c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:56.554149 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c6d104d7-dc84-457d-8343-7c34b50fd3c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:56.554792 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c6d104d7-dc84-457d-8343-7c34b50fd3c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:56.555565 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c6d104d7-dc84-457d-8343-7c34b50fd3c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:56.556023 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c6d104d7-dc84-457d-8343-7c34b50fd3c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:56.835787 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c6d104d7-dc84-457d-8343-7c34b50fd3c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291465 Nov 11 20:41:56.836542 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 418/762] 10.222.0.61 () {62 vars in 1363 bytes} [Thu Nov 11 20:41:56 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:41:56.948992 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-23a275ad-bfe7-476f-af9e-5fe1abdc4061 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:56.949551 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-23a275ad-bfe7-476f-af9e-5fe1abdc4061 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:56.956248 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-23a275ad-bfe7-476f-af9e-5fe1abdc4061 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:56.956930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-23a275ad-bfe7-476f-af9e-5fe1abdc4061 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:56.957461 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-23a275ad-bfe7-476f-af9e-5fe1abdc4061 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:56.957893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-23a275ad-bfe7-476f-af9e-5fe1abdc4061 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:57.048003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-23a275ad-bfe7-476f-af9e-5fe1abdc4061 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action" status: 202 len: 0 microversion: 2.20 time: 0.103498 Nov 11 20:41:57.048660 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 419/763] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:41:56 2021] POST /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 11 20:41:57.057431 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0d22f76f-bc5e-4392-9bf5-abc82539ff29 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:57.058326 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0d22f76f-bc5e-4392-9bf5-abc82539ff29 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:57.065028 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d22f76f-bc5e-4392-9bf5-abc82539ff29 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:57.065476 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d22f76f-bc5e-4392-9bf5-abc82539ff29 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:57.066481 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d22f76f-bc5e-4392-9bf5-abc82539ff29 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:57.067072 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0d22f76f-bc5e-4392-9bf5-abc82539ff29 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:57.208237 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0d22f76f-bc5e-4392-9bf5-abc82539ff29 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:57.216171 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0d22f76f-bc5e-4392-9bf5-abc82539ff29 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1514 microversion: 2.1 time: 0.163302 Nov 11 20:41:57.217080 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 420/764] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:57 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:57.222793 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-22665493-c8ca-4b02-acb7-91314568fba1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:57.223562 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-22665493-c8ca-4b02-acb7-91314568fba1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:57.230302 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-22665493-c8ca-4b02-acb7-91314568fba1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:57.231095 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-22665493-c8ca-4b02-acb7-91314568fba1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:57.232055 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-22665493-c8ca-4b02-acb7-91314568fba1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:57.232637 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-22665493-c8ca-4b02-acb7-91314568fba1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:57.377144 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-22665493-c8ca-4b02-acb7-91314568fba1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:57.387773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-22665493-c8ca-4b02-acb7-91314568fba1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:57.389573 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-22665493-c8ca-4b02-acb7-91314568fba1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:57.391073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-22665493-c8ca-4b02-acb7-91314568fba1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1810 microversion: 2.20 time: 0.172794 Nov 11 20:41:57.391905 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 421/765] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:57 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:57.406549 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5ee46437-37be-407d-93ef-8ca9dc999b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:57.407164 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5ee46437-37be-407d-93ef-8ca9dc999b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:57.413848 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5ee46437-37be-407d-93ef-8ca9dc999b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:57.414791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5ee46437-37be-407d-93ef-8ca9dc999b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:57.415935 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5ee46437-37be-407d-93ef-8ca9dc999b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:57.416607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5ee46437-37be-407d-93ef-8ca9dc999b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:57.575146 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5ee46437-37be-407d-93ef-8ca9dc999b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:57.584016 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5ee46437-37be-407d-93ef-8ca9dc999b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.190730 Nov 11 20:41:57.585578 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 422/766] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:57 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:58.233442 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ffe6069f-2b28-48bc-9c38-4903bae04f3d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:58.234082 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ffe6069f-2b28-48bc-9c38-4903bae04f3d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:58.239834 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ffe6069f-2b28-48bc-9c38-4903bae04f3d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:58.240309 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ffe6069f-2b28-48bc-9c38-4903bae04f3d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:58.241751 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ffe6069f-2b28-48bc-9c38-4903bae04f3d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:58.242178 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ffe6069f-2b28-48bc-9c38-4903bae04f3d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:58.372477 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ffe6069f-2b28-48bc-9c38-4903bae04f3d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:58.380199 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ffe6069f-2b28-48bc-9c38-4903bae04f3d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1514 microversion: 2.1 time: 0.150328 Nov 11 20:41:58.380763 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 423/767] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:58 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:58.409933 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5d42d1d1-cb35-434e-b827-8d69e40dd5cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:58.410533 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5d42d1d1-cb35-434e-b827-8d69e40dd5cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:58.417228 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5d42d1d1-cb35-434e-b827-8d69e40dd5cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:58.417679 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5d42d1d1-cb35-434e-b827-8d69e40dd5cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:58.418458 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5d42d1d1-cb35-434e-b827-8d69e40dd5cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:58.418892 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5d42d1d1-cb35-434e-b827-8d69e40dd5cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:58.547777 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5d42d1d1-cb35-434e-b827-8d69e40dd5cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:58.556456 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5d42d1d1-cb35-434e-b827-8d69e40dd5cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:58.557949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5d42d1d1-cb35-434e-b827-8d69e40dd5cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:58.559101 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5d42d1d1-cb35-434e-b827-8d69e40dd5cd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1810 microversion: 2.20 time: 0.152711 Nov 11 20:41:58.559662 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 424/768] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:58 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:41:58.602896 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4bb3a603-e120-47ba-b831-7bbd4137b716 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:58.603577 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4bb3a603-e120-47ba-b831-7bbd4137b716 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:58.609561 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4bb3a603-e120-47ba-b831-7bbd4137b716 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:58.610698 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4bb3a603-e120-47ba-b831-7bbd4137b716 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:58.611550 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4bb3a603-e120-47ba-b831-7bbd4137b716 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:58.612122 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4bb3a603-e120-47ba-b831-7bbd4137b716 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:58.747943 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-20fc9443-af8e-4414-9461-5ec20239154f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28787 microversion: 2.1 time: 2.612885 Nov 11 20:41:58.748420 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4bb3a603-e120-47ba-b831-7bbd4137b716 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:58.748737 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 345/769] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:56 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28787 bytes in 2615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:41:58.756098 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4bb3a603-e120-47ba-b831-7bbd4137b716 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.157923 Nov 11 20:41:58.757150 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 425/770] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:58 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:41:59.397367 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d37ba455-50ab-4163-b34f-cd5bf6727cfe tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:59.398089 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d37ba455-50ab-4163-b34f-cd5bf6727cfe tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:59.405584 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d37ba455-50ab-4163-b34f-cd5bf6727cfe tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:59.406185 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d37ba455-50ab-4163-b34f-cd5bf6727cfe tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:59.407007 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d37ba455-50ab-4163-b34f-cd5bf6727cfe tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:59.407445 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d37ba455-50ab-4163-b34f-cd5bf6727cfe tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:59.540915 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d37ba455-50ab-4163-b34f-cd5bf6727cfe tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:59.548579 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d37ba455-50ab-4163-b34f-cd5bf6727cfe tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1514 microversion: 2.1 time: 0.155396 Nov 11 20:41:59.549134 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 346/771] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:59 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:41:59.577500 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bfab20da-6b45-4e57-911d-01bf87945c8f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:59.578098 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-bfab20da-6b45-4e57-911d-01bf87945c8f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:59.585804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bfab20da-6b45-4e57-911d-01bf87945c8f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:59.586256 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bfab20da-6b45-4e57-911d-01bf87945c8f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:59.587050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bfab20da-6b45-4e57-911d-01bf87945c8f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:59.587523 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bfab20da-6b45-4e57-911d-01bf87945c8f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:59.727836 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-bfab20da-6b45-4e57-911d-01bf87945c8f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:59.736414 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-bfab20da-6b45-4e57-911d-01bf87945c8f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:59.737924 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-bfab20da-6b45-4e57-911d-01bf87945c8f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:59.739095 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bfab20da-6b45-4e57-911d-01bf87945c8f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1752 microversion: 2.20 time: 0.165333 Nov 11 20:41:59.739647 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 426/772] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:41:59 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:41:59.760254 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8c38004e-3f5a-4784-849b-7910840b2bd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:41:59.761165 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8c38004e-3f5a-4784-849b-7910840b2bd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:59.767665 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8c38004e-3f5a-4784-849b-7910840b2bd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:59.768245 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8c38004e-3f5a-4784-849b-7910840b2bd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:59.769192 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8c38004e-3f5a-4784-849b-7910840b2bd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:59.769675 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8c38004e-3f5a-4784-849b-7910840b2bd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:59.774010 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-92ed0e6b-bc65-4d7d-963b-ecc31c813ee4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:41:59.775413 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-92ed0e6b-bc65-4d7d-963b-ecc31c813ee4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:41:59.782803 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-92ed0e6b-bc65-4d7d-963b-ecc31c813ee4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:59.783325 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-92ed0e6b-bc65-4d7d-963b-ecc31c813ee4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:59.784514 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-92ed0e6b-bc65-4d7d-963b-ecc31c813ee4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:41:59.785659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-92ed0e6b-bc65-4d7d-963b-ecc31c813ee4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:41:59.869859 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8c38004e-3f5a-4784-849b-7910840b2bd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28787 microversion: 2.1 time: 0.113683 Nov 11 20:41:59.871092 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 347/773] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:41:59 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28787 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:41:59.923081 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-92ed0e6b-bc65-4d7d-963b-ecc31c813ee4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:41:59.931618 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-92ed0e6b-bc65-4d7d-963b-ecc31c813ee4 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.161310 Nov 11 20:41:59.941370 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 427/774] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:41:59 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:00.419696 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-c74bb290-1a62-414d-84e4-9a16316c6c78 req-5e02c1b4-6ebf-48b9-8998-20f8a31de319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f872205c-fe9f-4e51-8359-dd7e9e65f155", "name": "network-vif-deleted", "tag": "4edbb89c-4f5c-491a-9011-52c3c60a224c"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:00.421699 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:42:00.421699 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:42:00.433254 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-c74bb290-1a62-414d-84e4-9a16316c6c78 req-5e02c1b4-6ebf-48b9-8998-20f8a31de319 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:00.434366 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-c74bb290-1a62-414d-84e4-9a16316c6c78 req-5e02c1b4-6ebf-48b9-8998-20f8a31de319 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:00.446678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-c74bb290-1a62-414d-84e4-9a16316c6c78 req-5e02c1b4-6ebf-48b9-8998-20f8a31de319 service nova] Creating event network-vif-deleted:4edbb89c-4f5c-491a-9011-52c3c60a224c for instance f872205c-fe9f-4e51-8359-dd7e9e65f155 on hv-cinder-81764 Nov 11 20:42:00.452033 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-c74bb290-1a62-414d-84e4-9a16316c6c78 req-5e02c1b4-6ebf-48b9-8998-20f8a31de319 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037986 Nov 11 20:42:00.453262 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 348/775] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:42:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:00.566119 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a514fa88-43f8-42bd-b086-bb2c775e846a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:00.566722 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a514fa88-43f8-42bd-b086-bb2c775e846a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:00.586885 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a514fa88-43f8-42bd-b086-bb2c775e846a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:00.587642 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a514fa88-43f8-42bd-b086-bb2c775e846a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:00.588198 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a514fa88-43f8-42bd-b086-bb2c775e846a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:00.590011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a514fa88-43f8-42bd-b086-bb2c775e846a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:00.623609 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a514fa88-43f8-42bd-b086-bb2c775e846a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:00.624092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a514fa88-43f8-42bd-b086-bb2c775e846a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:00.624549 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-a514fa88-43f8-42bd-b086-bb2c775e846a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lazy-loading 'fault' on Instance uuid f872205c-fe9f-4e51-8359-dd7e9e65f155 {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:42:00.667041 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a514fa88-43f8-42bd-b086-bb2c775e846a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:00.674381 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a514fa88-43f8-42bd-b086-bb2c775e846a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 200 len: 1308 microversion: 2.1 time: 0.111950 Nov 11 20:42:00.674957 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 428/776] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:00 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:00.759630 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e7d91f27-d0b3-4be0-9514-d84fa2dcebb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:00.760468 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e7d91f27-d0b3-4be0-9514-d84fa2dcebb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:00.766489 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e7d91f27-d0b3-4be0-9514-d84fa2dcebb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:00.766931 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e7d91f27-d0b3-4be0-9514-d84fa2dcebb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:00.767701 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e7d91f27-d0b3-4be0-9514-d84fa2dcebb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:00.768195 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e7d91f27-d0b3-4be0-9514-d84fa2dcebb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:00.881499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d86dc681-baa6-43b4-9b54-0106077750ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:00.883778 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d86dc681-baa6-43b4-9b54-0106077750ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:00.889740 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d86dc681-baa6-43b4-9b54-0106077750ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:00.890289 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d86dc681-baa6-43b4-9b54-0106077750ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:00.891179 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d86dc681-baa6-43b4-9b54-0106077750ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:00.891677 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d86dc681-baa6-43b4-9b54-0106077750ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:00.903819 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e7d91f27-d0b3-4be0-9514-d84fa2dcebb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:00.911931 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e7d91f27-d0b3-4be0-9514-d84fa2dcebb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:00.913722 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e7d91f27-d0b3-4be0-9514-d84fa2dcebb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:00.914972 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e7d91f27-d0b3-4be0-9514-d84fa2dcebb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1752 microversion: 2.20 time: 0.160429 Nov 11 20:42:00.915538 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 349/777] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:00 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:00.948943 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-066504f0-456c-4c55-bd81-1b8aaea23664 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:00.949552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-066504f0-456c-4c55-bd81-1b8aaea23664 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:00.955614 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-066504f0-456c-4c55-bd81-1b8aaea23664 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:00.956100 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-066504f0-456c-4c55-bd81-1b8aaea23664 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:00.956882 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-066504f0-456c-4c55-bd81-1b8aaea23664 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:00.957408 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-066504f0-456c-4c55-bd81-1b8aaea23664 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:00.987313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d86dc681-baa6-43b4-9b54-0106077750ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 28787 microversion: 2.1 time: 0.109318 Nov 11 20:42:00.990163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 429/778] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:00 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 28787 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:42:01.093409 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-066504f0-456c-4c55-bd81-1b8aaea23664 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:01.102888 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-066504f0-456c-4c55-bd81-1b8aaea23664 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.158314 Nov 11 20:42:01.103434 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 350/779] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:00 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:01.690890 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-51fbbe17-65a5-4222-9daa-839f9892b9c4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:01.691574 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-51fbbe17-65a5-4222-9daa-839f9892b9c4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: f872205c-fe9f-4e51-8359-dd7e9e65f155] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:01.700330 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-51fbbe17-65a5-4222-9daa-839f9892b9c4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:01.700779 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-51fbbe17-65a5-4222-9daa-839f9892b9c4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:01.701568 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-51fbbe17-65a5-4222-9daa-839f9892b9c4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:01.702003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-51fbbe17-65a5-4222-9daa-839f9892b9c4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:01.716939 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-51fbbe17-65a5-4222-9daa-839f9892b9c4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] HTTP exception thrown: Instance f872205c-fe9f-4e51-8359-dd7e9e65f155 could not be found. Nov 11 20:42:01.717531 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-51fbbe17-65a5-4222-9daa-839f9892b9c4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Returning 404 to user: Instance f872205c-fe9f-4e51-8359-dd7e9e65f155 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:42:01.718359 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-51fbbe17-65a5-4222-9daa-839f9892b9c4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155" status: 404 len: 111 microversion: 2.1 time: 0.031485 Nov 11 20:42:01.718895 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 430/780] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:01 2021] GET /compute/v2.1/servers/f872205c-fe9f-4e51-8359-dd7e9e65f155 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:42:01.727641 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2924a2f8-46cb-4c09-b464-105556308efa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:01.728201 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2924a2f8-46cb-4c09-b464-105556308efa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:01.734653 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2924a2f8-46cb-4c09-b464-105556308efa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:01.735100 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2924a2f8-46cb-4c09-b464-105556308efa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:01.735923 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2924a2f8-46cb-4c09-b464-105556308efa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:01.736413 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2924a2f8-46cb-4c09-b464-105556308efa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:01.761745 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2924a2f8-46cb-4c09-b464-105556308efa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Going to try to terminate instance {{(pid=122527) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:42:01.834948 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2924a2f8-46cb-4c09-b464-105556308efa tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 204 len: 0 microversion: 2.1 time: 0.111545 Nov 11 20:42:01.835584 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 351/781] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:42:01 2021] DELETE /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:42:01.844289 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f57b62ec-1bad-4fc5-bf64-8adb36a13e6a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:01.845238 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f57b62ec-1bad-4fc5-bf64-8adb36a13e6a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:01.852952 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f57b62ec-1bad-4fc5-bf64-8adb36a13e6a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:01.853659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f57b62ec-1bad-4fc5-bf64-8adb36a13e6a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:01.854509 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f57b62ec-1bad-4fc5-bf64-8adb36a13e6a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:01.854940 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f57b62ec-1bad-4fc5-bf64-8adb36a13e6a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:01.934493 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b8c96b55-4cf6-4e7c-b50b-62c9f46e2af1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:01.935196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b8c96b55-4cf6-4e7c-b50b-62c9f46e2af1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:01.941129 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b8c96b55-4cf6-4e7c-b50b-62c9f46e2af1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:01.941583 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b8c96b55-4cf6-4e7c-b50b-62c9f46e2af1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:01.944019 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b8c96b55-4cf6-4e7c-b50b-62c9f46e2af1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:01.944019 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b8c96b55-4cf6-4e7c-b50b-62c9f46e2af1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:02.099558 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f57b62ec-1bad-4fc5-bf64-8adb36a13e6a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:02.107608 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f57b62ec-1bad-4fc5-bf64-8adb36a13e6a tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.267902 Nov 11 20:42:02.108317 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 431/782] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:01 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:02.121910 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2622d197-4a40-443c-888c-5b64c5c516dc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:02.122937 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2622d197-4a40-443c-888c-5b64c5c516dc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:02.128683 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2622d197-4a40-443c-888c-5b64c5c516dc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:02.129199 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2622d197-4a40-443c-888c-5b64c5c516dc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:02.130044 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2622d197-4a40-443c-888c-5b64c5c516dc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:02.130548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2622d197-4a40-443c-888c-5b64c5c516dc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:02.166057 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b8c96b55-4cf6-4e7c-b50b-62c9f46e2af1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:02.174867 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b8c96b55-4cf6-4e7c-b50b-62c9f46e2af1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:02.176532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b8c96b55-4cf6-4e7c-b50b-62c9f46e2af1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:02.177711 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b8c96b55-4cf6-4e7c-b50b-62c9f46e2af1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.247490 Nov 11 20:42:02.178288 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 352/783] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:01 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:42:02.183173 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-dd3fc2b4-dba8-4743-ab50-f4c5b9280294 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:02.183708 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-dd3fc2b4-dba8-4743-ab50-f4c5b9280294 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:02.189627 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dd3fc2b4-dba8-4743-ab50-f4c5b9280294 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:02.190305 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dd3fc2b4-dba8-4743-ab50-f4c5b9280294 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:02.191070 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dd3fc2b4-dba8-4743-ab50-f4c5b9280294 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:02.191504 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dd3fc2b4-dba8-4743-ab50-f4c5b9280294 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:02.286649 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2622d197-4a40-443c-888c-5b64c5c516dc tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 29074 microversion: 2.1 time: 0.168101 Nov 11 20:42:02.289081 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 432/784] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:02 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 29074 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:42:02.404985 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-dd3fc2b4-dba8-4743-ab50-f4c5b9280294 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:02.412682 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-dd3fc2b4-dba8-4743-ab50-f4c5b9280294 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.233020 Nov 11 20:42:02.413924 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 353/785] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:02 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:02.973518 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a52d576e-680e-43ed-8ca0-3a47c1072050 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:02.974102 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a52d576e-680e-43ed-8ca0-3a47c1072050 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:02.981974 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a52d576e-680e-43ed-8ca0-3a47c1072050 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:02.982436 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a52d576e-680e-43ed-8ca0-3a47c1072050 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:02.983233 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a52d576e-680e-43ed-8ca0-3a47c1072050 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:02.983677 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a52d576e-680e-43ed-8ca0-3a47c1072050 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:03.079025 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-a52d576e-680e-43ed-8ca0-3a47c1072050 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lazy-loading 'services' on Instance uuid 88a68a80-f2c4-48c3-ac43-f1e76012f3ea {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:42:03.127957 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-00caca5e-7fc8-454e-a9f5-723d2147fcf4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:03.128682 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-00caca5e-7fc8-454e-a9f5-723d2147fcf4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:03.136097 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-00caca5e-7fc8-454e-a9f5-723d2147fcf4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:03.136640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-00caca5e-7fc8-454e-a9f5-723d2147fcf4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:03.137664 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-00caca5e-7fc8-454e-a9f5-723d2147fcf4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:03.138176 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-00caca5e-7fc8-454e-a9f5-723d2147fcf4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:03.155807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a52d576e-680e-43ed-8ca0-3a47c1072050 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "DELETE /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea/os-volume_attachments/29a0f441-da9e-40af-a630-be24dfada5b8" status: 202 len: 0 microversion: 2.1 time: 0.186177 Nov 11 20:42:03.156503 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 433/786] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Nov 11 20:42:02 2021] DELETE /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea/os-volume_attachments/29a0f441-da9e-40af-a630-be24dfada5b8 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:42:03.199582 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-98105ffb-528e-47fa-bdec-7367a8f998d8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:03.200561 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-98105ffb-528e-47fa-bdec-7367a8f998d8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:03.211163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-98105ffb-528e-47fa-bdec-7367a8f998d8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:03.212503 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-98105ffb-528e-47fa-bdec-7367a8f998d8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:03.213632 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-98105ffb-528e-47fa-bdec-7367a8f998d8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:03.214213 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-98105ffb-528e-47fa-bdec-7367a8f998d8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:03.358956 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-00caca5e-7fc8-454e-a9f5-723d2147fcf4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:03.378487 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-00caca5e-7fc8-454e-a9f5-723d2147fcf4 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.257528 Nov 11 20:42:03.380924 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 354/787] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:03 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:03.391582 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b636e902-066d-489b-a8c2-ba4e08971c0d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:03.393105 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b636e902-066d-489b-a8c2-ba4e08971c0d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:03.403780 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b636e902-066d-489b-a8c2-ba4e08971c0d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:03.404784 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b636e902-066d-489b-a8c2-ba4e08971c0d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:03.405795 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b636e902-066d-489b-a8c2-ba4e08971c0d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:03.408844 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b636e902-066d-489b-a8c2-ba4e08971c0d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:03.427281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-98105ffb-528e-47fa-bdec-7367a8f998d8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:03.436673 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-98105ffb-528e-47fa-bdec-7367a8f998d8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:03.438259 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-98105ffb-528e-47fa-bdec-7367a8f998d8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:03.439422 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-98105ffb-528e-47fa-bdec-7367a8f998d8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.246330 Nov 11 20:42:03.440343 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 434/788] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:03 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:42:03.447557 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1fca6bf7-226b-4115-a813-2c1e4623dbe3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:03.448195 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1fca6bf7-226b-4115-a813-2c1e4623dbe3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:03.456463 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1fca6bf7-226b-4115-a813-2c1e4623dbe3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:03.456983 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1fca6bf7-226b-4115-a813-2c1e4623dbe3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:03.457863 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1fca6bf7-226b-4115-a813-2c1e4623dbe3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:03.458363 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1fca6bf7-226b-4115-a813-2c1e4623dbe3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:03.519129 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b636e902-066d-489b-a8c2-ba4e08971c0d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 29074 microversion: 2.1 time: 0.132960 Nov 11 20:42:03.519885 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 355/789] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:03 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 29074 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:42:03.607419 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1fca6bf7-226b-4115-a813-2c1e4623dbe3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:03.615791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1fca6bf7-226b-4115-a813-2c1e4623dbe3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.174249 Nov 11 20:42:03.624297 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 435/790] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:03 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:04.397858 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9619b469-3910-49f5-b861-be7a69e05427 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:04.398699 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9619b469-3910-49f5-b861-be7a69e05427 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:04.405968 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9619b469-3910-49f5-b861-be7a69e05427 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:04.406474 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9619b469-3910-49f5-b861-be7a69e05427 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:04.407260 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9619b469-3910-49f5-b861-be7a69e05427 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:04.407779 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9619b469-3910-49f5-b861-be7a69e05427 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:04.457540 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5e919e87-1aa5-4901-bbd8-dc2de2475fa5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:04.458788 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5e919e87-1aa5-4901-bbd8-dc2de2475fa5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:04.465294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5e919e87-1aa5-4901-bbd8-dc2de2475fa5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:04.466016 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5e919e87-1aa5-4901-bbd8-dc2de2475fa5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:04.466893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5e919e87-1aa5-4901-bbd8-dc2de2475fa5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:04.467400 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5e919e87-1aa5-4901-bbd8-dc2de2475fa5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:04.581331 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9619b469-3910-49f5-b861-be7a69e05427 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:04.593128 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9619b469-3910-49f5-b861-be7a69e05427 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.199148 Nov 11 20:42:04.594715 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 356/791] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:04 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:04.607165 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c2034e74-fe9e-4181-8a75-c577770349a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:04.608554 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c2034e74-fe9e-4181-8a75-c577770349a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:04.623116 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c2034e74-fe9e-4181-8a75-c577770349a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:04.623567 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c2034e74-fe9e-4181-8a75-c577770349a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:04.624402 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c2034e74-fe9e-4181-8a75-c577770349a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:04.625026 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c2034e74-fe9e-4181-8a75-c577770349a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:04.668089 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5e919e87-1aa5-4901-bbd8-dc2de2475fa5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:04.676530 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5e919e87-1aa5-4901-bbd8-dc2de2475fa5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:04.678254 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5e919e87-1aa5-4901-bbd8-dc2de2475fa5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:04.680895 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5e919e87-1aa5-4901-bbd8-dc2de2475fa5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.227306 Nov 11 20:42:04.692336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 436/792] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:04 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:42:04.699522 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e28e5fa3-e21d-48c8-8d23-23a22e4d2367 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:04.700162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e28e5fa3-e21d-48c8-8d23-23a22e4d2367 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:04.706293 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e28e5fa3-e21d-48c8-8d23-23a22e4d2367 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:04.706793 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e28e5fa3-e21d-48c8-8d23-23a22e4d2367 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:04.707815 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e28e5fa3-e21d-48c8-8d23-23a22e4d2367 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:04.708274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e28e5fa3-e21d-48c8-8d23-23a22e4d2367 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:04.858931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e28e5fa3-e21d-48c8-8d23-23a22e4d2367 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:04.867953 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e28e5fa3-e21d-48c8-8d23-23a22e4d2367 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.173881 Nov 11 20:42:04.874309 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 437/793] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:04 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:05.610569 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-be3b2af0-afed-4fdf-b631-f25896da5f67 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:05.611211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-be3b2af0-afed-4fdf-b631-f25896da5f67 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:05.617737 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-be3b2af0-afed-4fdf-b631-f25896da5f67 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:05.618185 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-be3b2af0-afed-4fdf-b631-f25896da5f67 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:05.618965 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-be3b2af0-afed-4fdf-b631-f25896da5f67 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:05.619391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-be3b2af0-afed-4fdf-b631-f25896da5f67 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:05.753957 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-be3b2af0-afed-4fdf-b631-f25896da5f67 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:05.761896 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-be3b2af0-afed-4fdf-b631-f25896da5f67 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.155023 Nov 11 20:42:05.762464 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 438/794] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:05 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:05.766651 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7e89dd91-2601-41d1-9cb6-6a05aaff7ca6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:05.767247 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7e89dd91-2601-41d1-9cb6-6a05aaff7ca6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:05.773538 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7e89dd91-2601-41d1-9cb6-6a05aaff7ca6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:05.773998 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7e89dd91-2601-41d1-9cb6-6a05aaff7ca6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:05.774849 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7e89dd91-2601-41d1-9cb6-6a05aaff7ca6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:05.775291 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7e89dd91-2601-41d1-9cb6-6a05aaff7ca6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:05.923429 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7e89dd91-2601-41d1-9cb6-6a05aaff7ca6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:05.937968 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7e89dd91-2601-41d1-9cb6-6a05aaff7ca6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:05.940796 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7e89dd91-2601-41d1-9cb6-6a05aaff7ca6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:05.943118 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7e89dd91-2601-41d1-9cb6-6a05aaff7ca6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.179480 Nov 11 20:42:05.950366 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 439/795] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:05 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:05.952057 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-608b15ba-ddf0-42d8-a058-ed024ed67ef6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:05.952878 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-608b15ba-ddf0-42d8-a058-ed024ed67ef6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:05.964894 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-608b15ba-ddf0-42d8-a058-ed024ed67ef6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:05.965464 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-608b15ba-ddf0-42d8-a058-ed024ed67ef6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:05.966691 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-608b15ba-ddf0-42d8-a058-ed024ed67ef6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:05.967547 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-608b15ba-ddf0-42d8-a058-ed024ed67ef6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:06.130358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-608b15ba-ddf0-42d8-a058-ed024ed67ef6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:06.138226 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-608b15ba-ddf0-42d8-a058-ed024ed67ef6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.192709 Nov 11 20:42:06.138837 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 440/796] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:05 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:06.779374 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fcd5abf5-a99c-4c95-a913-8a73f916b804 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:06.780916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fcd5abf5-a99c-4c95-a913-8a73f916b804 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:06.791123 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fcd5abf5-a99c-4c95-a913-8a73f916b804 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:06.792013 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fcd5abf5-a99c-4c95-a913-8a73f916b804 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:06.793207 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fcd5abf5-a99c-4c95-a913-8a73f916b804 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:06.793701 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fcd5abf5-a99c-4c95-a913-8a73f916b804 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:06.925410 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fcd5abf5-a99c-4c95-a913-8a73f916b804 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:06.934141 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fcd5abf5-a99c-4c95-a913-8a73f916b804 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.159071 Nov 11 20:42:06.934914 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 441/797] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:06 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:06.964772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fbc7250e-2328-4070-80a3-ae26ab3c4c1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:06.965386 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fbc7250e-2328-4070-80a3-ae26ab3c4c1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:06.971354 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbc7250e-2328-4070-80a3-ae26ab3c4c1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:06.971824 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbc7250e-2328-4070-80a3-ae26ab3c4c1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:06.972676 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbc7250e-2328-4070-80a3-ae26ab3c4c1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:06.973114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fbc7250e-2328-4070-80a3-ae26ab3c4c1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:07.115293 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fbc7250e-2328-4070-80a3-ae26ab3c4c1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:07.127233 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fbc7250e-2328-4070-80a3-ae26ab3c4c1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:07.130523 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fbc7250e-2328-4070-80a3-ae26ab3c4c1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:07.131798 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fbc7250e-2328-4070-80a3-ae26ab3c4c1b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.172092 Nov 11 20:42:07.132432 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 442/798] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:06 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:07.158107 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-75d835df-fcfc-434d-80d0-66e6fabfeb96 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:07.158723 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-75d835df-fcfc-434d-80d0-66e6fabfeb96 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:07.165248 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-75d835df-fcfc-434d-80d0-66e6fabfeb96 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:07.165701 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-75d835df-fcfc-434d-80d0-66e6fabfeb96 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:07.166493 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-75d835df-fcfc-434d-80d0-66e6fabfeb96 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:07.166936 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-75d835df-fcfc-434d-80d0-66e6fabfeb96 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:07.322083 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-75d835df-fcfc-434d-80d0-66e6fabfeb96 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:07.329951 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-75d835df-fcfc-434d-80d0-66e6fabfeb96 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.176072 Nov 11 20:42:07.330773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 443/799] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:07 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:07.952672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-43071900-ffb8-45e6-af6c-07b47e6962f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:07.953336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-43071900-ffb8-45e6-af6c-07b47e6962f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:07.963029 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-43071900-ffb8-45e6-af6c-07b47e6962f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:07.963814 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-43071900-ffb8-45e6-af6c-07b47e6962f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:07.964949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-43071900-ffb8-45e6-af6c-07b47e6962f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:07.965398 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-43071900-ffb8-45e6-af6c-07b47e6962f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:08.105019 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-43071900-ffb8-45e6-af6c-07b47e6962f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:08.112678 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-43071900-ffb8-45e6-af6c-07b47e6962f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.165519 Nov 11 20:42:08.113442 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 444/800] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:07 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:08.151433 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cf95209e-b138-44ab-b154-f4ea2ab32a66 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:08.152060 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cf95209e-b138-44ab-b154-f4ea2ab32a66 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:08.157959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cf95209e-b138-44ab-b154-f4ea2ab32a66 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:08.158401 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cf95209e-b138-44ab-b154-f4ea2ab32a66 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:08.159181 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cf95209e-b138-44ab-b154-f4ea2ab32a66 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:08.159611 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cf95209e-b138-44ab-b154-f4ea2ab32a66 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:08.308627 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cf95209e-b138-44ab-b154-f4ea2ab32a66 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:08.317754 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cf95209e-b138-44ab-b154-f4ea2ab32a66 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:08.319270 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cf95209e-b138-44ab-b154-f4ea2ab32a66 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:08.320466 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cf95209e-b138-44ab-b154-f4ea2ab32a66 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.173103 Nov 11 20:42:08.321015 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 445/801] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:08 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:42:08.353579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e2dbfccb-4d81-479b-af36-3f101046c813 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:08.354854 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e2dbfccb-4d81-479b-af36-3f101046c813 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:08.362050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e2dbfccb-4d81-479b-af36-3f101046c813 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:08.363154 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e2dbfccb-4d81-479b-af36-3f101046c813 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:08.364242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e2dbfccb-4d81-479b-af36-3f101046c813 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:08.364699 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e2dbfccb-4d81-479b-af36-3f101046c813 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:08.533649 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e2dbfccb-4d81-479b-af36-3f101046c813 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:08.542605 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e2dbfccb-4d81-479b-af36-3f101046c813 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.198486 Nov 11 20:42:08.543168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 446/802] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:08 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:09.130789 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9e70d3ff-01ed-44b4-bf27-b9424a064170 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:09.131503 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9e70d3ff-01ed-44b4-bf27-b9424a064170 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:09.144970 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9e70d3ff-01ed-44b4-bf27-b9424a064170 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:09.145509 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9e70d3ff-01ed-44b4-bf27-b9424a064170 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:09.146379 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9e70d3ff-01ed-44b4-bf27-b9424a064170 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:09.146890 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9e70d3ff-01ed-44b4-bf27-b9424a064170 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:09.313929 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9e70d3ff-01ed-44b4-bf27-b9424a064170 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:09.321882 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9e70d3ff-01ed-44b4-bf27-b9424a064170 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.194974 Nov 11 20:42:09.322444 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 447/803] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:09 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:09.339274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-123274b8-a092-401a-aeee-749b73637f33 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:09.339872 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-123274b8-a092-401a-aeee-749b73637f33 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:09.347343 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-123274b8-a092-401a-aeee-749b73637f33 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:09.347790 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-123274b8-a092-401a-aeee-749b73637f33 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:09.348617 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-123274b8-a092-401a-aeee-749b73637f33 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:09.349048 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-123274b8-a092-401a-aeee-749b73637f33 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:09.518966 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-123274b8-a092-401a-aeee-749b73637f33 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:09.526621 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-123274b8-a092-401a-aeee-749b73637f33 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:09.528307 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-123274b8-a092-401a-aeee-749b73637f33 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:09.529859 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-123274b8-a092-401a-aeee-749b73637f33 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.194731 Nov 11 20:42:09.530982 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 448/804] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:09 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:09.561445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e507e710-7330-4b2c-a7d5-ca39baae1c1e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:09.562224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e507e710-7330-4b2c-a7d5-ca39baae1c1e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:09.569018 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e507e710-7330-4b2c-a7d5-ca39baae1c1e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:09.569655 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e507e710-7330-4b2c-a7d5-ca39baae1c1e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:09.570585 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e507e710-7330-4b2c-a7d5-ca39baae1c1e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:09.571087 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e507e710-7330-4b2c-a7d5-ca39baae1c1e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:09.717336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e507e710-7330-4b2c-a7d5-ca39baae1c1e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:09.725225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e507e710-7330-4b2c-a7d5-ca39baae1c1e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.169443 Nov 11 20:42:09.735808 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 449/805] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:09 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:10.338904 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d9c34b9b-bfec-4181-8828-77e3b78c8599 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:10.339928 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d9c34b9b-bfec-4181-8828-77e3b78c8599 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:10.346589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d9c34b9b-bfec-4181-8828-77e3b78c8599 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:10.347037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d9c34b9b-bfec-4181-8828-77e3b78c8599 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:10.354982 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d9c34b9b-bfec-4181-8828-77e3b78c8599 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:10.355445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d9c34b9b-bfec-4181-8828-77e3b78c8599 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:10.529222 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d9c34b9b-bfec-4181-8828-77e3b78c8599 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:10.536653 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d9c34b9b-bfec-4181-8828-77e3b78c8599 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.201815 Nov 11 20:42:10.537603 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 450/806] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:10 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:10.548815 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-01d2d85b-5000-463f-89bd-809480f105af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:10.549792 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-01d2d85b-5000-463f-89bd-809480f105af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:10.557071 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-01d2d85b-5000-463f-89bd-809480f105af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:10.557570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-01d2d85b-5000-463f-89bd-809480f105af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:10.558394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-01d2d85b-5000-463f-89bd-809480f105af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:10.559126 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-01d2d85b-5000-463f-89bd-809480f105af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:10.734782 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-01d2d85b-5000-463f-89bd-809480f105af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:10.759635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-01d2d85b-5000-463f-89bd-809480f105af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:10.761073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-01d2d85b-5000-463f-89bd-809480f105af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:10.772484 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-01d2d85b-5000-463f-89bd-809480f105af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.218470 Nov 11 20:42:10.789588 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 451/807] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:10 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:10.794872 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-622ee3be-3d73-46b6-844d-78d374507b44 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:10.795483 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-622ee3be-3d73-46b6-844d-78d374507b44 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:10.813082 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-622ee3be-3d73-46b6-844d-78d374507b44 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:10.813486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-622ee3be-3d73-46b6-844d-78d374507b44 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:10.814809 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-622ee3be-3d73-46b6-844d-78d374507b44 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:10.815291 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-622ee3be-3d73-46b6-844d-78d374507b44 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:11.017472 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-622ee3be-3d73-46b6-844d-78d374507b44 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:11.026141 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-622ee3be-3d73-46b6-844d-78d374507b44 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.235342 Nov 11 20:42:11.026711 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 452/808] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:10 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:11.557541 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-54e204eb-8b5d-47b8-b7e7-b3183b53f98c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:11.558216 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-54e204eb-8b5d-47b8-b7e7-b3183b53f98c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:11.566110 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-54e204eb-8b5d-47b8-b7e7-b3183b53f98c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:11.566552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-54e204eb-8b5d-47b8-b7e7-b3183b53f98c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:11.567383 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-54e204eb-8b5d-47b8-b7e7-b3183b53f98c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:11.567813 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-54e204eb-8b5d-47b8-b7e7-b3183b53f98c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:11.743440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-54e204eb-8b5d-47b8-b7e7-b3183b53f98c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:11.764986 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-54e204eb-8b5d-47b8-b7e7-b3183b53f98c tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.211479 Nov 11 20:42:11.766105 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 453/809] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:11 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:11.793395 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-342dd396-eb5b-48e7-9546-feb995201444 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:11.794146 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-342dd396-eb5b-48e7-9546-feb995201444 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:11.800952 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-342dd396-eb5b-48e7-9546-feb995201444 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:11.801400 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-342dd396-eb5b-48e7-9546-feb995201444 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:11.802218 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-342dd396-eb5b-48e7-9546-feb995201444 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:11.802764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-342dd396-eb5b-48e7-9546-feb995201444 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:12.033567 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-342dd396-eb5b-48e7-9546-feb995201444 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:12.051222 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-342dd396-eb5b-48e7-9546-feb995201444 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:12.052777 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-342dd396-eb5b-48e7-9546-feb995201444 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:12.054186 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-342dd396-eb5b-48e7-9546-feb995201444 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.265545 Nov 11 20:42:12.066667 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 454/810] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:11 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:12.066667 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7edfc82e-dd1f-4a55-b80c-5fb2597a1b72 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:12.066667 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7edfc82e-dd1f-4a55-b80c-5fb2597a1b72 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:12.081600 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7edfc82e-dd1f-4a55-b80c-5fb2597a1b72 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:12.082059 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7edfc82e-dd1f-4a55-b80c-5fb2597a1b72 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:12.087768 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7edfc82e-dd1f-4a55-b80c-5fb2597a1b72 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:12.088290 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7edfc82e-dd1f-4a55-b80c-5fb2597a1b72 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:12.275846 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7edfc82e-dd1f-4a55-b80c-5fb2597a1b72 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:12.284860 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7edfc82e-dd1f-4a55-b80c-5fb2597a1b72 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.224610 Nov 11 20:42:12.285706 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 455/811] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:12 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:12.782647 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1fb53e94-1980-45dd-bbdb-d80589135ca2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:12.783952 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1fb53e94-1980-45dd-bbdb-d80589135ca2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:12.812983 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1fb53e94-1980-45dd-bbdb-d80589135ca2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:12.813441 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1fb53e94-1980-45dd-bbdb-d80589135ca2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:12.814250 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1fb53e94-1980-45dd-bbdb-d80589135ca2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:12.814684 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1fb53e94-1980-45dd-bbdb-d80589135ca2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:13.109320 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1fb53e94-1980-45dd-bbdb-d80589135ca2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:13.118832 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1fb53e94-1980-45dd-bbdb-d80589135ca2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.339768 Nov 11 20:42:13.119672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 456/812] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:12 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:13.124712 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-75901354-042d-454b-b25b-273a5bf13bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:13.125619 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-75901354-042d-454b-b25b-273a5bf13bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:13.132539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-75901354-042d-454b-b25b-273a5bf13bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:13.133344 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-75901354-042d-454b-b25b-273a5bf13bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:13.134461 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-75901354-042d-454b-b25b-273a5bf13bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:13.135302 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-75901354-042d-454b-b25b-273a5bf13bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:13.372794 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-75901354-042d-454b-b25b-273a5bf13bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:13.383481 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-75901354-042d-454b-b25b-273a5bf13bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:13.385179 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-75901354-042d-454b-b25b-273a5bf13bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:13.386350 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-75901354-042d-454b-b25b-273a5bf13bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.265446 Nov 11 20:42:13.386912 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 457/813] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:13 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:13.392190 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9e20d84b-9215-4d7a-9328-d9d38459f1f6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:13.392786 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9e20d84b-9215-4d7a-9328-d9d38459f1f6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:13.399099 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9e20d84b-9215-4d7a-9328-d9d38459f1f6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:13.399922 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9e20d84b-9215-4d7a-9328-d9d38459f1f6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:13.400734 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9e20d84b-9215-4d7a-9328-d9d38459f1f6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:13.401162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9e20d84b-9215-4d7a-9328-d9d38459f1f6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:13.611424 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9e20d84b-9215-4d7a-9328-d9d38459f1f6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:13.619824 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9e20d84b-9215-4d7a-9328-d9d38459f1f6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.231747 Nov 11 20:42:13.620809 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 458/814] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:13 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:14.136329 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a5ac2b31-d2f2-4066-a1d5-a3e420b5b2b2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:14.137034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a5ac2b31-d2f2-4066-a1d5-a3e420b5b2b2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:14.143292 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a5ac2b31-d2f2-4066-a1d5-a3e420b5b2b2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:14.144058 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a5ac2b31-d2f2-4066-a1d5-a3e420b5b2b2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:14.145281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a5ac2b31-d2f2-4066-a1d5-a3e420b5b2b2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:14.145524 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a5ac2b31-d2f2-4066-a1d5-a3e420b5b2b2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:14.418052 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a5ac2b31-d2f2-4066-a1d5-a3e420b5b2b2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:14.425930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a5ac2b31-d2f2-4066-a1d5-a3e420b5b2b2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.294356 Nov 11 20:42:14.426916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 459/815] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:14 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:14.445795 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8bff96da-96cf-4f2e-8f43-7e8b61e9718d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:14.451046 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8bff96da-96cf-4f2e-8f43-7e8b61e9718d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:14.468229 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8bff96da-96cf-4f2e-8f43-7e8b61e9718d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:14.468671 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8bff96da-96cf-4f2e-8f43-7e8b61e9718d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:14.469673 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8bff96da-96cf-4f2e-8f43-7e8b61e9718d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:14.470265 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8bff96da-96cf-4f2e-8f43-7e8b61e9718d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:14.721606 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8bff96da-96cf-4f2e-8f43-7e8b61e9718d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:14.731507 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8bff96da-96cf-4f2e-8f43-7e8b61e9718d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:14.733514 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8bff96da-96cf-4f2e-8f43-7e8b61e9718d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:14.734940 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8bff96da-96cf-4f2e-8f43-7e8b61e9718d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.307028 Nov 11 20:42:14.735709 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 460/816] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:14 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:14.749647 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9a694121-5dc1-495a-81eb-a5f9e22b42a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:14.750650 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9a694121-5dc1-495a-81eb-a5f9e22b42a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:14.758614 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9a694121-5dc1-495a-81eb-a5f9e22b42a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:14.759161 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9a694121-5dc1-495a-81eb-a5f9e22b42a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:14.760093 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9a694121-5dc1-495a-81eb-a5f9e22b42a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:14.760664 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9a694121-5dc1-495a-81eb-a5f9e22b42a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:15.032158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9a694121-5dc1-495a-81eb-a5f9e22b42a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:15.052430 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9a694121-5dc1-495a-81eb-a5f9e22b42a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.315295 Nov 11 20:42:15.058372 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 461/817] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:14 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:15.442823 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9b2e53c1-5eb9-419b-834f-5f4d6a43e497 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:15.443535 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9b2e53c1-5eb9-419b-834f-5f4d6a43e497 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:15.450364 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9b2e53c1-5eb9-419b-834f-5f4d6a43e497 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:15.450818 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9b2e53c1-5eb9-419b-834f-5f4d6a43e497 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:15.451609 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9b2e53c1-5eb9-419b-834f-5f4d6a43e497 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:15.452072 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9b2e53c1-5eb9-419b-834f-5f4d6a43e497 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:15.599402 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9b2e53c1-5eb9-419b-834f-5f4d6a43e497 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:15.615071 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9b2e53c1-5eb9-419b-834f-5f4d6a43e497 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.175738 Nov 11 20:42:15.626395 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 462/818] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:15 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:15.754643 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a67b6bcb-9c56-4267-aec3-6e4e8f0a15c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:15.755385 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a67b6bcb-9c56-4267-aec3-6e4e8f0a15c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:15.764405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a67b6bcb-9c56-4267-aec3-6e4e8f0a15c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:15.765526 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a67b6bcb-9c56-4267-aec3-6e4e8f0a15c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:15.766399 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a67b6bcb-9c56-4267-aec3-6e4e8f0a15c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:15.766903 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a67b6bcb-9c56-4267-aec3-6e4e8f0a15c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:16.027313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a67b6bcb-9c56-4267-aec3-6e4e8f0a15c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:16.044112 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a67b6bcb-9c56-4267-aec3-6e4e8f0a15c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:16.047476 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a67b6bcb-9c56-4267-aec3-6e4e8f0a15c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:16.048956 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a67b6bcb-9c56-4267-aec3-6e4e8f0a15c5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.299338 Nov 11 20:42:16.050054 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 463/819] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:15 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:42:16.083466 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8ed65e55-99c2-43d2-8db7-0cff2a9ced68 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:16.084124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8ed65e55-99c2-43d2-8db7-0cff2a9ced68 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:16.104283 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ed65e55-99c2-43d2-8db7-0cff2a9ced68 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:16.104798 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ed65e55-99c2-43d2-8db7-0cff2a9ced68 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:16.105576 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ed65e55-99c2-43d2-8db7-0cff2a9ced68 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:16.108779 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8ed65e55-99c2-43d2-8db7-0cff2a9ced68 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:16.361300 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8ed65e55-99c2-43d2-8db7-0cff2a9ced68 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:16.373504 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8ed65e55-99c2-43d2-8db7-0cff2a9ced68 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.294419 Nov 11 20:42:16.385579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 464/820] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:16 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:16.633006 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0371a983-55ba-4bdd-a099-42e6c2ce5c7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:16.634675 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0371a983-55ba-4bdd-a099-42e6c2ce5c7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:16.641316 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0371a983-55ba-4bdd-a099-42e6c2ce5c7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:16.642110 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0371a983-55ba-4bdd-a099-42e6c2ce5c7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:16.643136 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0371a983-55ba-4bdd-a099-42e6c2ce5c7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:16.643786 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0371a983-55ba-4bdd-a099-42e6c2ce5c7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:16.798760 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0371a983-55ba-4bdd-a099-42e6c2ce5c7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:16.807153 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0371a983-55ba-4bdd-a099-42e6c2ce5c7e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.178534 Nov 11 20:42:16.816772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 465/821] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:16 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:17.067758 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cc511d6d-2e91-4003-80dc-b6c4a264cc06 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:17.068723 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cc511d6d-2e91-4003-80dc-b6c4a264cc06 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:17.075192 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cc511d6d-2e91-4003-80dc-b6c4a264cc06 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:17.075999 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cc511d6d-2e91-4003-80dc-b6c4a264cc06 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:17.077030 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cc511d6d-2e91-4003-80dc-b6c4a264cc06 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:17.077537 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cc511d6d-2e91-4003-80dc-b6c4a264cc06 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:17.279639 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cc511d6d-2e91-4003-80dc-b6c4a264cc06 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:17.289547 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cc511d6d-2e91-4003-80dc-b6c4a264cc06 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:17.291582 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cc511d6d-2e91-4003-80dc-b6c4a264cc06 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:17.292536 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cc511d6d-2e91-4003-80dc-b6c4a264cc06 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.228546 Nov 11 20:42:17.294084 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 466/822] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:17 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:42:17.396767 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-393c9bb7-ab87-4092-986f-718dedd13698 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:17.400954 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-393c9bb7-ab87-4092-986f-718dedd13698 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:17.410794 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-393c9bb7-ab87-4092-986f-718dedd13698 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:17.412872 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-393c9bb7-ab87-4092-986f-718dedd13698 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:17.415570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-393c9bb7-ab87-4092-986f-718dedd13698 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:17.416916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-393c9bb7-ab87-4092-986f-718dedd13698 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:17.610476 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-393c9bb7-ab87-4092-986f-718dedd13698 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:17.620848 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-393c9bb7-ab87-4092-986f-718dedd13698 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.231278 Nov 11 20:42:17.650875 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 467/823] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:17 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:17.827195 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c74f3c8e-9277-4385-b901-f7f22521eda2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:17.827916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c74f3c8e-9277-4385-b901-f7f22521eda2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:17.836157 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c74f3c8e-9277-4385-b901-f7f22521eda2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:17.836791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c74f3c8e-9277-4385-b901-f7f22521eda2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:17.837669 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c74f3c8e-9277-4385-b901-f7f22521eda2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:17.838294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c74f3c8e-9277-4385-b901-f7f22521eda2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:18.151500 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c74f3c8e-9277-4385-b901-f7f22521eda2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:18.162878 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c74f3c8e-9277-4385-b901-f7f22521eda2 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.340703 Nov 11 20:42:18.172035 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 468/824] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:17 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:18.313385 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d859da68-799f-4026-8d24-afab0e427726 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:18.314651 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d859da68-799f-4026-8d24-afab0e427726 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:18.323814 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d859da68-799f-4026-8d24-afab0e427726 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:18.324699 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d859da68-799f-4026-8d24-afab0e427726 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:18.325796 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d859da68-799f-4026-8d24-afab0e427726 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:18.326615 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d859da68-799f-4026-8d24-afab0e427726 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:18.609062 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d859da68-799f-4026-8d24-afab0e427726 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:18.619130 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d859da68-799f-4026-8d24-afab0e427726 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:18.620773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d859da68-799f-4026-8d24-afab0e427726 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:18.622130 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d859da68-799f-4026-8d24-afab0e427726 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.313381 Nov 11 20:42:18.623130 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 469/825] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:18 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:42:18.640559 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ab28efae-192a-4437-8f9b-eaab6e03f2a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:18.641518 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ab28efae-192a-4437-8f9b-eaab6e03f2a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:18.648317 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ab28efae-192a-4437-8f9b-eaab6e03f2a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:18.649183 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ab28efae-192a-4437-8f9b-eaab6e03f2a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:18.650358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ab28efae-192a-4437-8f9b-eaab6e03f2a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:18.651035 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ab28efae-192a-4437-8f9b-eaab6e03f2a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:19.370377 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ab28efae-192a-4437-8f9b-eaab6e03f2a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:19.375268 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ab28efae-192a-4437-8f9b-eaab6e03f2a5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.740032 Nov 11 20:42:19.385618 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 470/826] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:18 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:19.392959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2cfa307a-8a39-4c06-baaa-4efa29022a7f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:19.393571 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2cfa307a-8a39-4c06-baaa-4efa29022a7f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:19.408182 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2cfa307a-8a39-4c06-baaa-4efa29022a7f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:19.408624 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2cfa307a-8a39-4c06-baaa-4efa29022a7f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:19.409486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2cfa307a-8a39-4c06-baaa-4efa29022a7f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:19.409915 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2cfa307a-8a39-4c06-baaa-4efa29022a7f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:19.947855 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2cfa307a-8a39-4c06-baaa-4efa29022a7f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:19.964888 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2cfa307a-8a39-4c06-baaa-4efa29022a7f tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.577776 Nov 11 20:42:19.965811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 471/827] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:19 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:19.983280 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b34e9dfe-8346-4a4c-af3c-2d1827228249 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:19.986633 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b34e9dfe-8346-4a4c-af3c-2d1827228249 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:20.007398 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b34e9dfe-8346-4a4c-af3c-2d1827228249 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:20.007940 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b34e9dfe-8346-4a4c-af3c-2d1827228249 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:20.008807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b34e9dfe-8346-4a4c-af3c-2d1827228249 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:20.009256 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b34e9dfe-8346-4a4c-af3c-2d1827228249 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:20.424031 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b34e9dfe-8346-4a4c-af3c-2d1827228249 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:20.438974 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b34e9dfe-8346-4a4c-af3c-2d1827228249 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:20.440825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b34e9dfe-8346-4a4c-af3c-2d1827228249 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:20.446594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b34e9dfe-8346-4a4c-af3c-2d1827228249 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.474275 Nov 11 20:42:20.447222 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 472/828] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:19 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:20.458873 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e370128d-6a32-47e6-a112-8b81d31f5509 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:20.459762 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e370128d-6a32-47e6-a112-8b81d31f5509 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:20.467523 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e370128d-6a32-47e6-a112-8b81d31f5509 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:20.468011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e370128d-6a32-47e6-a112-8b81d31f5509 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:20.468842 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e370128d-6a32-47e6-a112-8b81d31f5509 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:20.469289 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e370128d-6a32-47e6-a112-8b81d31f5509 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:20.785493 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e370128d-6a32-47e6-a112-8b81d31f5509 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:20.794175 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e370128d-6a32-47e6-a112-8b81d31f5509 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.345720 Nov 11 20:42:20.795691 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 473/829] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:20 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:20.982205 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-046cc936-c452-470b-8ca7-f7e0aad1de73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:20.982809 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-046cc936-c452-470b-8ca7-f7e0aad1de73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:20.989403 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-046cc936-c452-470b-8ca7-f7e0aad1de73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:20.989844 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-046cc936-c452-470b-8ca7-f7e0aad1de73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:20.990625 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-046cc936-c452-470b-8ca7-f7e0aad1de73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:20.991058 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-046cc936-c452-470b-8ca7-f7e0aad1de73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:21.287219 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-046cc936-c452-470b-8ca7-f7e0aad1de73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:21.317380 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-046cc936-c452-470b-8ca7-f7e0aad1de73 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.338714 Nov 11 20:42:21.328550 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 474/830] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:20 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:21.466439 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5b3995a5-c4b6-4e4c-b11d-7e8ddf1d099d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:21.467045 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5b3995a5-c4b6-4e4c-b11d-7e8ddf1d099d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:21.474718 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b3995a5-c4b6-4e4c-b11d-7e8ddf1d099d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:21.475427 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b3995a5-c4b6-4e4c-b11d-7e8ddf1d099d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:21.476513 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b3995a5-c4b6-4e4c-b11d-7e8ddf1d099d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:21.477014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b3995a5-c4b6-4e4c-b11d-7e8ddf1d099d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:21.750666 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5b3995a5-c4b6-4e4c-b11d-7e8ddf1d099d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:21.760340 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5b3995a5-c4b6-4e4c-b11d-7e8ddf1d099d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:21.762415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5b3995a5-c4b6-4e4c-b11d-7e8ddf1d099d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:21.763682 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5b3995a5-c4b6-4e4c-b11d-7e8ddf1d099d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.301562 Nov 11 20:42:21.768625 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 475/831] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:21 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:42:21.813283 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-64170c16-cc35-4878-b547-dc6446954866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:21.813892 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-64170c16-cc35-4878-b547-dc6446954866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:21.821099 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-64170c16-cc35-4878-b547-dc6446954866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:21.821540 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-64170c16-cc35-4878-b547-dc6446954866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:21.822338 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-64170c16-cc35-4878-b547-dc6446954866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:21.822757 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-64170c16-cc35-4878-b547-dc6446954866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:22.095225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-64170c16-cc35-4878-b547-dc6446954866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:22.106394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-64170c16-cc35-4878-b547-dc6446954866 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.296923 Nov 11 20:42:22.107456 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 476/832] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:21 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:22.501456 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6e0a731f-a86b-4af8-a1dd-4ee4c82b3890 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Action: 'create', calling method: .version_select at 0x7ff3ee43fa60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-897741008"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:22.517440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-6e0a731f-a86b-4af8-a1dd-4ee4c82b3890 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Getting quotas for project 4dd611087eb441dc94ef8c18b6b7d600. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:42:22.524661 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-6e0a731f-a86b-4af8-a1dd-4ee4c82b3890 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Getting quotas for user 32c40f3d5b074a22b2c48caef9230615 and project 4dd611087eb441dc94ef8c18b6b7d600. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:42:22.760257 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-6e0a731f-a86b-4af8-a1dd-4ee4c82b3890 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Getting quotas for project 4dd611087eb441dc94ef8c18b6b7d600. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:42:22.764044 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-6e0a731f-a86b-4af8-a1dd-4ee4c82b3890 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Getting quotas for user 32c40f3d5b074a22b2c48caef9230615 and project 4dd611087eb441dc94ef8c18b6b7d600. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:42:22.781939 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6e0a731f-a86b-4af8-a1dd-4ee4c82b3890 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.498985 Nov 11 20:42:22.782545 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 477/833] 10.222.0.61 () {60 vars in 1157 bytes} [Thu Nov 11 20:42:22 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:22.786900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a9041b1b-b419-4759-a9a9-cf04584029f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:22.788476 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a9041b1b-b419-4759-a9a9-cf04584029f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:22.794604 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9041b1b-b419-4759-a9a9-cf04584029f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:22.795228 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9041b1b-b419-4759-a9a9-cf04584029f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:22.796225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9041b1b-b419-4759-a9a9-cf04584029f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:22.796852 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9041b1b-b419-4759-a9a9-cf04584029f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:23.029757 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a9041b1b-b419-4759-a9a9-cf04584029f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:23.050615 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a9041b1b-b419-4759-a9a9-cf04584029f5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.266511 Nov 11 20:42:23.054297 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 478/834] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:22 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:23.067701 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-da1c6299-fc8a-4e8e-8679-d7af203f7558 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:23.068346 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-da1c6299-fc8a-4e8e-8679-d7af203f7558 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:23.076968 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-da1c6299-fc8a-4e8e-8679-d7af203f7558 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:23.077718 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-da1c6299-fc8a-4e8e-8679-d7af203f7558 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:23.078768 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-da1c6299-fc8a-4e8e-8679-d7af203f7558 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:23.079446 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-da1c6299-fc8a-4e8e-8679-d7af203f7558 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:23.240460 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-da1c6299-fc8a-4e8e-8679-d7af203f7558 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:23.256757 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-da1c6299-fc8a-4e8e-8679-d7af203f7558 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:23.258987 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-da1c6299-fc8a-4e8e-8679-d7af203f7558 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:23.284582 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-da1c6299-fc8a-4e8e-8679-d7af203f7558 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.227556 Nov 11 20:42:23.289899 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 479/835] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:23 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:23.305985 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ec10824e-d3bb-4296-a2e9-51fbddc0b592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:23.306644 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ec10824e-d3bb-4296-a2e9-51fbddc0b592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:23.313578 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ec10824e-d3bb-4296-a2e9-51fbddc0b592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:23.314020 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ec10824e-d3bb-4296-a2e9-51fbddc0b592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:23.315331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ec10824e-d3bb-4296-a2e9-51fbddc0b592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:23.316104 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ec10824e-d3bb-4296-a2e9-51fbddc0b592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:23.522904 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ec10824e-d3bb-4296-a2e9-51fbddc0b592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:23.531558 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ec10824e-d3bb-4296-a2e9-51fbddc0b592 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.230189 Nov 11 20:42:23.532237 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 480/836] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:23 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:24.073335 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9faae68a-c656-4e5a-a03f-250e43f2cfc8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:24.074353 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9faae68a-c656-4e5a-a03f-250e43f2cfc8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:24.081327 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9faae68a-c656-4e5a-a03f-250e43f2cfc8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:24.082061 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9faae68a-c656-4e5a-a03f-250e43f2cfc8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:24.083061 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9faae68a-c656-4e5a-a03f-250e43f2cfc8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:24.083689 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9faae68a-c656-4e5a-a03f-250e43f2cfc8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:24.299031 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9faae68a-c656-4e5a-a03f-250e43f2cfc8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:24.310451 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9faae68a-c656-4e5a-a03f-250e43f2cfc8 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.241419 Nov 11 20:42:24.311283 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 481/837] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:24 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:24.327353 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-af32fd47-9fd7-4e18-9477-efe90bea3bca tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:24.327507 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-af32fd47-9fd7-4e18-9477-efe90bea3bca tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:24.334231 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af32fd47-9fd7-4e18-9477-efe90bea3bca tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:24.334680 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af32fd47-9fd7-4e18-9477-efe90bea3bca tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:24.335825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af32fd47-9fd7-4e18-9477-efe90bea3bca tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:24.336558 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af32fd47-9fd7-4e18-9477-efe90bea3bca tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:24.521819 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-af32fd47-9fd7-4e18-9477-efe90bea3bca tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:24.531265 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-af32fd47-9fd7-4e18-9477-efe90bea3bca tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:24.533313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-af32fd47-9fd7-4e18-9477-efe90bea3bca tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:24.534465 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-af32fd47-9fd7-4e18-9477-efe90bea3bca tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.217311 Nov 11 20:42:24.535232 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 482/838] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:24 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:24.550732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-afb11f5f-bc59-4dad-9a0a-28edc75f1142 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:24.551512 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-afb11f5f-bc59-4dad-9a0a-28edc75f1142 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:24.560294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-afb11f5f-bc59-4dad-9a0a-28edc75f1142 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:24.561029 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-afb11f5f-bc59-4dad-9a0a-28edc75f1142 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:24.562403 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-afb11f5f-bc59-4dad-9a0a-28edc75f1142 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:24.563456 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-afb11f5f-bc59-4dad-9a0a-28edc75f1142 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:24.759168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-afb11f5f-bc59-4dad-9a0a-28edc75f1142 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:24.769775 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-afb11f5f-bc59-4dad-9a0a-28edc75f1142 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.223703 Nov 11 20:42:24.780791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 483/839] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:24 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:25.327539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-45acaf84-39ed-4bc1-9d0b-e9b6e792400e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:25.328233 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-45acaf84-39ed-4bc1-9d0b-e9b6e792400e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:25.334752 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-45acaf84-39ed-4bc1-9d0b-e9b6e792400e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:25.335737 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-45acaf84-39ed-4bc1-9d0b-e9b6e792400e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:25.336555 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-45acaf84-39ed-4bc1-9d0b-e9b6e792400e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:25.336988 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-45acaf84-39ed-4bc1-9d0b-e9b6e792400e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:25.470920 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-45acaf84-39ed-4bc1-9d0b-e9b6e792400e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:25.478695 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-45acaf84-39ed-4bc1-9d0b-e9b6e792400e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.155009 Nov 11 20:42:25.479268 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 484/840] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:25 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:25.554421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-aff2ff95-b4dd-4fcf-9e1d-120e0acf4437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:25.555021 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-aff2ff95-b4dd-4fcf-9e1d-120e0acf4437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:25.561227 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aff2ff95-b4dd-4fcf-9e1d-120e0acf4437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:25.561671 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aff2ff95-b4dd-4fcf-9e1d-120e0acf4437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:25.562450 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aff2ff95-b4dd-4fcf-9e1d-120e0acf4437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:25.562875 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aff2ff95-b4dd-4fcf-9e1d-120e0acf4437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:25.706718 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-aff2ff95-b4dd-4fcf-9e1d-120e0acf4437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:25.719832 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-aff2ff95-b4dd-4fcf-9e1d-120e0acf4437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:25.721594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-aff2ff95-b4dd-4fcf-9e1d-120e0acf4437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:25.722797 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-aff2ff95-b4dd-4fcf-9e1d-120e0acf4437 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.172114 Nov 11 20:42:25.723357 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 485/841] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:25 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:42:25.786713 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0ba89299-954b-430d-b5d3-895de6edd9ba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:25.787671 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0ba89299-954b-430d-b5d3-895de6edd9ba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:25.795392 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ba89299-954b-430d-b5d3-895de6edd9ba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:25.795893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ba89299-954b-430d-b5d3-895de6edd9ba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:25.797105 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ba89299-954b-430d-b5d3-895de6edd9ba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:25.797275 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ba89299-954b-430d-b5d3-895de6edd9ba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:25.877823 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c2034e74-fe9e-4181-8a75-c577770349a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 35582 microversion: 2.1 time: 21.281719 Nov 11 20:42:25.879903 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 357/842] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:04 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 35582 bytes in 21284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:42:26.024585 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0ba89299-954b-430d-b5d3-895de6edd9ba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:26.032398 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0ba89299-954b-430d-b5d3-895de6edd9ba tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.249755 Nov 11 20:42:26.032977 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 486/843] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:25 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:26.496207 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3b0ba0e0-4e09-4121-b165-0531d6dbeb38 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:26.496891 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3b0ba0e0-4e09-4121-b165-0531d6dbeb38 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:26.504305 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3b0ba0e0-4e09-4121-b165-0531d6dbeb38 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:26.504759 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3b0ba0e0-4e09-4121-b165-0531d6dbeb38 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:26.505551 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3b0ba0e0-4e09-4121-b165-0531d6dbeb38 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:26.505992 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3b0ba0e0-4e09-4121-b165-0531d6dbeb38 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:26.730201 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3b0ba0e0-4e09-4121-b165-0531d6dbeb38 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:26.737864 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3b0ba0e0-4e09-4121-b165-0531d6dbeb38 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1513 microversion: 2.1 time: 0.246404 Nov 11 20:42:26.738464 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 358/844] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:26 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:26.742442 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c7c45010-fb61-4c84-9957-2e77ca536336 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:26.743246 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c7c45010-fb61-4c84-9957-2e77ca536336 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:26.751414 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c7c45010-fb61-4c84-9957-2e77ca536336 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:26.751884 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c7c45010-fb61-4c84-9957-2e77ca536336 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:26.752761 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c7c45010-fb61-4c84-9957-2e77ca536336 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:26.753200 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c7c45010-fb61-4c84-9957-2e77ca536336 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:26.891270 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-180478f1-d71d-4c68-a526-040665c92db3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:26.892202 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-180478f1-d71d-4c68-a526-040665c92db3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:26.894823 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c7c45010-fb61-4c84-9957-2e77ca536336 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:26.901210 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-180478f1-d71d-4c68-a526-040665c92db3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:26.901848 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-180478f1-d71d-4c68-a526-040665c92db3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:26.902819 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-180478f1-d71d-4c68-a526-040665c92db3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:26.903433 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-180478f1-d71d-4c68-a526-040665c92db3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:26.908159 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c7c45010-fb61-4c84-9957-2e77ca536336 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:26.911513 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c7c45010-fb61-4c84-9957-2e77ca536336 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:26.912760 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c7c45010-fb61-4c84-9957-2e77ca536336 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.174802 Nov 11 20:42:26.913455 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 487/845] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:26 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:42:26.957821 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a4078f29-f094-435e-a6c0-0040869ebea5 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:26.958337 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a4078f29-f094-435e-a6c0-0040869ebea5 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:26.974014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a4078f29-f094-435e-a6c0-0040869ebea5 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:26.974449 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a4078f29-f094-435e-a6c0-0040869ebea5 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:26.975277 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a4078f29-f094-435e-a6c0-0040869ebea5 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:26.976302 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a4078f29-f094-435e-a6c0-0040869ebea5 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:27.004386 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a4078f29-f094-435e-a6c0-0040869ebea5 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Going to try to terminate instance {{(pid=122526) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:42:27.067622 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-180478f1-d71d-4c68-a526-040665c92db3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 35825 microversion: 2.1 time: 0.179588 Nov 11 20:42:27.068930 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 359/846] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:26 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 35825 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:42:27.074397 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ce61c6bf-66f8-4018-bec7-9a890bb22d9b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:27.075107 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ce61c6bf-66f8-4018-bec7-9a890bb22d9b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:27.082631 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce61c6bf-66f8-4018-bec7-9a890bb22d9b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:27.083273 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce61c6bf-66f8-4018-bec7-9a890bb22d9b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:27.084105 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce61c6bf-66f8-4018-bec7-9a890bb22d9b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:27.084544 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ce61c6bf-66f8-4018-bec7-9a890bb22d9b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:27.087069 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a4078f29-f094-435e-a6c0-0040869ebea5 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "DELETE /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 204 len: 0 microversion: 2.1 time: 0.133607 Nov 11 20:42:27.087952 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 488/847] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:42:26 2021] DELETE /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 11 20:42:27.098651 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-64803ba6-1991-485b-a4d7-d74cf502738d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:27.099408 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-64803ba6-1991-485b-a4d7-d74cf502738d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:27.106848 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-64803ba6-1991-485b-a4d7-d74cf502738d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:27.108668 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-64803ba6-1991-485b-a4d7-d74cf502738d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:27.109150 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-64803ba6-1991-485b-a4d7-d74cf502738d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:27.109587 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-64803ba6-1991-485b-a4d7-d74cf502738d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:27.305405 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ce61c6bf-66f8-4018-bec7-9a890bb22d9b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:27.309967 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-64803ba6-1991-485b-a4d7-d74cf502738d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:27.313575 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ce61c6bf-66f8-4018-bec7-9a890bb22d9b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.243315 Nov 11 20:42:27.314164 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 360/848] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:27 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:27.317931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-64803ba6-1991-485b-a4d7-d74cf502738d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1513 microversion: 2.1 time: 0.225307 Nov 11 20:42:27.318489 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 489/849] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:27 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:27.755876 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6262c60a-5ca7-41f9-9f8c-c6543b3cb5b5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:27.756972 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6262c60a-5ca7-41f9-9f8c-c6543b3cb5b5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:27.763919 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6262c60a-5ca7-41f9-9f8c-c6543b3cb5b5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:27.764852 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6262c60a-5ca7-41f9-9f8c-c6543b3cb5b5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:27.769031 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6262c60a-5ca7-41f9-9f8c-c6543b3cb5b5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:27.769693 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6262c60a-5ca7-41f9-9f8c-c6543b3cb5b5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:27.837567 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-a4cfb3ec-c91c-4d94-9e28-79daf0cc36c7 req-50e3c8c6-4026-40c3-ab0c-7c40fc5f5d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bded2955-e01c-44b7-8296-944f839f06b9", "name": "network-vif-deleted", "tag": "29fa7464-b08b-4f56-89c0-b86091d4eb50"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:27.839141 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:42:27.839141 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:42:27.846542 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-a4cfb3ec-c91c-4d94-9e28-79daf0cc36c7 req-50e3c8c6-4026-40c3-ab0c-7c40fc5f5d3d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:27.847206 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-a4cfb3ec-c91c-4d94-9e28-79daf0cc36c7 req-50e3c8c6-4026-40c3-ab0c-7c40fc5f5d3d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:27.853627 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-6262c60a-5ca7-41f9-9f8c-c6543b3cb5b5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:27.864109 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6262c60a-5ca7-41f9-9f8c-c6543b3cb5b5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1471 microversion: 2.1 time: 0.112033 Nov 11 20:42:27.870734 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 361/850] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:27 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1471 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:27.878286 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-a4cfb3ec-c91c-4d94-9e28-79daf0cc36c7 req-50e3c8c6-4026-40c3-ab0c-7c40fc5f5d3d service nova] Creating event network-vif-deleted:29fa7464-b08b-4f56-89c0-b86091d4eb50 for instance bded2955-e01c-44b7-8296-944f839f06b9 on hv-cinder-81764 Nov 11 20:42:27.883584 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-a4cfb3ec-c91c-4d94-9e28-79daf0cc36c7 req-50e3c8c6-4026-40c3-ab0c-7c40fc5f5d3d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050168 Nov 11 20:42:27.886865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 490/851] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:42:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:42:27.930706 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9a1d1dcf-be0f-4ee2-9c62-a56dce3e2b8b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:27.931582 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9a1d1dcf-be0f-4ee2-9c62-a56dce3e2b8b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:27.937632 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9a1d1dcf-be0f-4ee2-9c62-a56dce3e2b8b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:27.938155 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9a1d1dcf-be0f-4ee2-9c62-a56dce3e2b8b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:27.939003 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9a1d1dcf-be0f-4ee2-9c62-a56dce3e2b8b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:27.939504 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9a1d1dcf-be0f-4ee2-9c62-a56dce3e2b8b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:28.080524 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-66a62629-5225-4884-b450-46deb08d3bee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:28.082039 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-66a62629-5225-4884-b450-46deb08d3bee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:28.083195 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9a1d1dcf-be0f-4ee2-9c62-a56dce3e2b8b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:28.089062 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-66a62629-5225-4884-b450-46deb08d3bee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:28.089512 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-66a62629-5225-4884-b450-46deb08d3bee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:28.090313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-66a62629-5225-4884-b450-46deb08d3bee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:28.090764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-66a62629-5225-4884-b450-46deb08d3bee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:28.094413 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9a1d1dcf-be0f-4ee2-9c62-a56dce3e2b8b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:28.095936 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9a1d1dcf-be0f-4ee2-9c62-a56dce3e2b8b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:28.097111 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9a1d1dcf-be0f-4ee2-9c62-a56dce3e2b8b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.170391 Nov 11 20:42:28.097659 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 362/852] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:27 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:28.230586 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-66a62629-5225-4884-b450-46deb08d3bee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 36176 microversion: 2.1 time: 0.154085 Nov 11 20:42:28.231501 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 491/853] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:28 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 36176 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:42:28.332511 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-608b5343-9f27-4e1c-ac01-05e7fc8b563e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:28.333122 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-608b5343-9f27-4e1c-ac01-05e7fc8b563e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:28.337315 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ddf9b7ab-94a8-48ba-bcda-3e5e76a835e7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:28.338013 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ddf9b7ab-94a8-48ba-bcda-3e5e76a835e7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:28.339366 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-608b5343-9f27-4e1c-ac01-05e7fc8b563e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:28.339816 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-608b5343-9f27-4e1c-ac01-05e7fc8b563e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:28.340646 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-608b5343-9f27-4e1c-ac01-05e7fc8b563e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:28.341174 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-608b5343-9f27-4e1c-ac01-05e7fc8b563e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:28.346705 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ddf9b7ab-94a8-48ba-bcda-3e5e76a835e7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:28.347165 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ddf9b7ab-94a8-48ba-bcda-3e5e76a835e7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:28.347958 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ddf9b7ab-94a8-48ba-bcda-3e5e76a835e7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:28.348415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ddf9b7ab-94a8-48ba-bcda-3e5e76a835e7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:28.539469 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ddf9b7ab-94a8-48ba-bcda-3e5e76a835e7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:28.546855 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ddf9b7ab-94a8-48ba-bcda-3e5e76a835e7 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1513 microversion: 2.1 time: 0.214142 Nov 11 20:42:28.547081 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-608b5343-9f27-4e1c-ac01-05e7fc8b563e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:28.547428 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 492/854] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:28 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:28.555188 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-608b5343-9f27-4e1c-ac01-05e7fc8b563e tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.226748 Nov 11 20:42:28.555734 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 363/855] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:28 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:28.888014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d41abd38-9b7b-4696-859b-5914022ef013 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:28.888668 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d41abd38-9b7b-4696-859b-5914022ef013 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:28.894845 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d41abd38-9b7b-4696-859b-5914022ef013 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:28.895293 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d41abd38-9b7b-4696-859b-5914022ef013 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:28.896096 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d41abd38-9b7b-4696-859b-5914022ef013 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:28.896530 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d41abd38-9b7b-4696-859b-5914022ef013 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:28.928637 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d41abd38-9b7b-4696-859b-5914022ef013 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:28.929685 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d41abd38-9b7b-4696-859b-5914022ef013 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:28.930135 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-d41abd38-9b7b-4696-859b-5914022ef013 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lazy-loading 'fault' on Instance uuid bded2955-e01c-44b7-8296-944f839f06b9 {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:42:28.969916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d41abd38-9b7b-4696-859b-5914022ef013 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:28.977236 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d41abd38-9b7b-4696-859b-5914022ef013 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 200 len: 1308 microversion: 2.1 time: 0.092930 Nov 11 20:42:28.977794 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 493/856] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:28 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:29.115597 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0209ec34-6c34-4f52-a48a-e7cdfed97703 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:29.116218 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0209ec34-6c34-4f52-a48a-e7cdfed97703 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:29.122934 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0209ec34-6c34-4f52-a48a-e7cdfed97703 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:29.123467 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0209ec34-6c34-4f52-a48a-e7cdfed97703 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:29.124285 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0209ec34-6c34-4f52-a48a-e7cdfed97703 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:29.124716 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0209ec34-6c34-4f52-a48a-e7cdfed97703 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:29.242367 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4941e00d-59a4-4d2c-9265-a1b5f3ca3032 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:29.243294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4941e00d-59a4-4d2c-9265-a1b5f3ca3032 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:29.249533 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4941e00d-59a4-4d2c-9265-a1b5f3ca3032 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:29.250176 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4941e00d-59a4-4d2c-9265-a1b5f3ca3032 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:29.250967 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4941e00d-59a4-4d2c-9265-a1b5f3ca3032 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:29.251411 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4941e00d-59a4-4d2c-9265-a1b5f3ca3032 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:29.259777 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0209ec34-6c34-4f52-a48a-e7cdfed97703 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:29.268476 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0209ec34-6c34-4f52-a48a-e7cdfed97703 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:29.269958 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0209ec34-6c34-4f52-a48a-e7cdfed97703 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:29.271291 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0209ec34-6c34-4f52-a48a-e7cdfed97703 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.159545 Nov 11 20:42:29.271847 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 364/857] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:29 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:29.368969 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4941e00d-59a4-4d2c-9265-a1b5f3ca3032 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 36609 microversion: 2.1 time: 0.130226 Nov 11 20:42:29.369625 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 494/858] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:29 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 36609 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:42:29.564111 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-272af9f7-3934-40a2-9622-2de37fca8988 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:29.564625 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-272af9f7-3934-40a2-9622-2de37fca8988 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:29.571172 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-272af9f7-3934-40a2-9622-2de37fca8988 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:29.571620 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-272af9f7-3934-40a2-9622-2de37fca8988 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:29.572390 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-26895d69-50f3-4fcd-9705-cc6f81d6825a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:29.572528 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-272af9f7-3934-40a2-9622-2de37fca8988 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:29.572840 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-272af9f7-3934-40a2-9622-2de37fca8988 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:29.573221 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-26895d69-50f3-4fcd-9705-cc6f81d6825a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:29.579955 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-26895d69-50f3-4fcd-9705-cc6f81d6825a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:29.580458 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-26895d69-50f3-4fcd-9705-cc6f81d6825a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:29.581527 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-26895d69-50f3-4fcd-9705-cc6f81d6825a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:29.581967 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-26895d69-50f3-4fcd-9705-cc6f81d6825a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:29.769909 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-272af9f7-3934-40a2-9622-2de37fca8988 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:29.775638 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-26895d69-50f3-4fcd-9705-cc6f81d6825a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:29.778619 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-272af9f7-3934-40a2-9622-2de37fca8988 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1513 microversion: 2.1 time: 0.218281 Nov 11 20:42:29.779569 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 365/859] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:29 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:29.783732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-26895d69-50f3-4fcd-9705-cc6f81d6825a tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.215506 Nov 11 20:42:29.796113 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 495/860] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:29 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:29.994451 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-962c6949-25e3-47a4-8243-e80ffefac930 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:29.995067 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-962c6949-25e3-47a4-8243-e80ffefac930 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: bded2955-e01c-44b7-8296-944f839f06b9] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:30.001400 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-962c6949-25e3-47a4-8243-e80ffefac930 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:30.001854 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-962c6949-25e3-47a4-8243-e80ffefac930 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:30.002678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-962c6949-25e3-47a4-8243-e80ffefac930 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:30.003112 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-962c6949-25e3-47a4-8243-e80ffefac930 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:30.016881 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-962c6949-25e3-47a4-8243-e80ffefac930 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] HTTP exception thrown: Instance bded2955-e01c-44b7-8296-944f839f06b9 could not be found. Nov 11 20:42:30.017474 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-962c6949-25e3-47a4-8243-e80ffefac930 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Returning 404 to user: Instance bded2955-e01c-44b7-8296-944f839f06b9 could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:42:30.018295 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-962c6949-25e3-47a4-8243-e80ffefac930 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9" status: 404 len: 111 microversion: 2.1 time: 0.027989 Nov 11 20:42:30.018825 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 366/861] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:29 2021] GET /compute/v2.1/servers/bded2955-e01c-44b7-8296-944f839f06b9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:42:30.290245 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-544d065b-364c-45a0-ab6c-d3bb33f59c00 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:30.290773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-544d065b-364c-45a0-ab6c-d3bb33f59c00 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:30.297260 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-544d065b-364c-45a0-ab6c-d3bb33f59c00 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:30.297703 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-544d065b-364c-45a0-ab6c-d3bb33f59c00 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:30.298476 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-544d065b-364c-45a0-ab6c-d3bb33f59c00 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:30.298905 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-544d065b-364c-45a0-ab6c-d3bb33f59c00 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:30.379885 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9c83bbfc-2553-42f0-a06b-39c27f966788 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:30.381088 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9c83bbfc-2553-42f0-a06b-39c27f966788 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:30.387742 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9c83bbfc-2553-42f0-a06b-39c27f966788 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:30.388287 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9c83bbfc-2553-42f0-a06b-39c27f966788 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:30.389249 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9c83bbfc-2553-42f0-a06b-39c27f966788 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:30.389681 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9c83bbfc-2553-42f0-a06b-39c27f966788 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:30.438625 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-544d065b-364c-45a0-ab6c-d3bb33f59c00 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:30.448544 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-544d065b-364c-45a0-ab6c-d3bb33f59c00 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:30.450786 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-544d065b-364c-45a0-ab6c-d3bb33f59c00 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:30.451966 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-544d065b-364c-45a0-ab6c-d3bb33f59c00 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.165724 Nov 11 20:42:30.452840 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 496/862] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:30 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:30.507198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9c83bbfc-2553-42f0-a06b-39c27f966788 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 37054 microversion: 2.1 time: 0.130647 Nov 11 20:42:30.507895 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 367/863] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:30 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 37054 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:42:30.797013 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f9342a81-bf05-4704-9e4f-3092c785522e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:30.797726 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f9342a81-bf05-4704-9e4f-3092c785522e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:30.805599 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f9342a81-bf05-4704-9e4f-3092c785522e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:30.806158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f9342a81-bf05-4704-9e4f-3092c785522e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:30.807011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f9342a81-bf05-4704-9e4f-3092c785522e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:30.807369 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-efa8b224-6baf-4d01-b861-a1af716f329d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:30.807564 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f9342a81-bf05-4704-9e4f-3092c785522e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:30.808236 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-efa8b224-6baf-4d01-b861-a1af716f329d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:30.820406 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-efa8b224-6baf-4d01-b861-a1af716f329d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:30.820958 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-efa8b224-6baf-4d01-b861-a1af716f329d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:30.821842 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-efa8b224-6baf-4d01-b861-a1af716f329d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:30.822356 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-efa8b224-6baf-4d01-b861-a1af716f329d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:31.371706 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f9342a81-bf05-4704-9e4f-3092c785522e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:31.380987 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f9342a81-bf05-4704-9e4f-3092c785522e tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1513 microversion: 2.1 time: 0.587593 Nov 11 20:42:31.381570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 497/864] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:30 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1513 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:31.386837 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-09200418-2512-45e9-a2fe-c1b19148217d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:31.387337 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-09200418-2512-45e9-a2fe-c1b19148217d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:31.393849 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-09200418-2512-45e9-a2fe-c1b19148217d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:31.394295 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-09200418-2512-45e9-a2fe-c1b19148217d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:31.395147 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-efa8b224-6baf-4d01-b861-a1af716f329d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:31.395771 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-09200418-2512-45e9-a2fe-c1b19148217d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:31.395771 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-09200418-2512-45e9-a2fe-c1b19148217d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:31.407328 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-efa8b224-6baf-4d01-b861-a1af716f329d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.603488 Nov 11 20:42:31.407916 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 368/865] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:30 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:31.433385 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-09200418-2512-45e9-a2fe-c1b19148217d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Going to try to terminate instance {{(pid=122526) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:42:31.443816 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fb86a9bc-cb54-4705-8f2c-5cf4328f304e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:31.446716 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fb86a9bc-cb54-4705-8f2c-5cf4328f304e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:31.455164 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fb86a9bc-cb54-4705-8f2c-5cf4328f304e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:31.455700 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fb86a9bc-cb54-4705-8f2c-5cf4328f304e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:31.456933 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fb86a9bc-cb54-4705-8f2c-5cf4328f304e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:31.457523 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fb86a9bc-cb54-4705-8f2c-5cf4328f304e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:31.533750 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-09200418-2512-45e9-a2fe-c1b19148217d tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 204 len: 0 microversion: 2.1 time: 0.150052 Nov 11 20:42:31.534533 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 498/866] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:42:31 2021] DELETE /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:42:31.541080 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4546dd0b-8d80-4c19-a7ee-b2ee23650b12 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:31.541781 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4546dd0b-8d80-4c19-a7ee-b2ee23650b12 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:31.546943 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fb86a9bc-cb54-4705-8f2c-5cf4328f304e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "POST /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/action" status: 202 len: 0 microversion: 2.1 time: 0.106856 Nov 11 20:42:31.547568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 369/867] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:31 2021] POST /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:42:31.547930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4546dd0b-8d80-4c19-a7ee-b2ee23650b12 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:31.548421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4546dd0b-8d80-4c19-a7ee-b2ee23650b12 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:31.549467 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4546dd0b-8d80-4c19-a7ee-b2ee23650b12 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:31.549906 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4546dd0b-8d80-4c19-a7ee-b2ee23650b12 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:31.554919 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6db2c04d-219b-42dd-91b9-1351c7a4e5c1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:31.556198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6db2c04d-219b-42dd-91b9-1351c7a4e5c1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:31.562359 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6db2c04d-219b-42dd-91b9-1351c7a4e5c1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:31.563146 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6db2c04d-219b-42dd-91b9-1351c7a4e5c1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:31.564199 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6db2c04d-219b-42dd-91b9-1351c7a4e5c1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:31.564841 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6db2c04d-219b-42dd-91b9-1351c7a4e5c1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:31.672280 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6db2c04d-219b-42dd-91b9-1351c7a4e5c1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 37542 microversion: 2.1 time: 0.122519 Nov 11 20:42:31.676468 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 370/868] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:31 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 37542 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:42:31.677824 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4f0bb8a2-d835-4a6d-b878-fc9bef85e468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:31.678521 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4f0bb8a2-d835-4a6d-b878-fc9bef85e468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:31.686049 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4f0bb8a2-d835-4a6d-b878-fc9bef85e468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:31.686738 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4f0bb8a2-d835-4a6d-b878-fc9bef85e468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:31.687619 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4f0bb8a2-d835-4a6d-b878-fc9bef85e468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:31.688087 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4f0bb8a2-d835-4a6d-b878-fc9bef85e468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:31.852261 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4546dd0b-8d80-4c19-a7ee-b2ee23650b12 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:31.862304 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4546dd0b-8d80-4c19-a7ee-b2ee23650b12 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:31.863942 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4546dd0b-8d80-4c19-a7ee-b2ee23650b12 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:31.865192 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4546dd0b-8d80-4c19-a7ee-b2ee23650b12 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.329471 Nov 11 20:42:31.865824 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 499/869] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:31 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:31.870067 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2f9d7ad5-a6b4-44b7-b76b-115fb683bee6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:31.870659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2f9d7ad5-a6b4-44b7-b76b-115fb683bee6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:31.876336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2f9d7ad5-a6b4-44b7-b76b-115fb683bee6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:31.877891 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2f9d7ad5-a6b4-44b7-b76b-115fb683bee6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:31.878294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2f9d7ad5-a6b4-44b7-b76b-115fb683bee6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:31.878793 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2f9d7ad5-a6b4-44b7-b76b-115fb683bee6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:32.065317 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-4f0bb8a2-d835-4a6d-b878-fc9bef85e468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:32.073635 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4f0bb8a2-d835-4a6d-b878-fc9bef85e468 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1513 microversion: 2.1 time: 0.399571 Nov 11 20:42:32.074236 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 371/870] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:31 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1513 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:32.078847 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-c99c82f7-7aa1-4967-9886-408484243a86 req-ac454640-6bf4-4850-b108-4a4a5412211d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a68a80-f2c4-48c3-ac43-f1e76012f3ea", "name": "network-vif-deleted", "tag": "55137242-2e6b-4a3a-a796-20d6c605c358"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:32.082535 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:42:32.082535 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:42:32.090828 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-c99c82f7-7aa1-4967-9886-408484243a86 req-ac454640-6bf4-4850-b108-4a4a5412211d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:32.091276 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-c99c82f7-7aa1-4967-9886-408484243a86 req-ac454640-6bf4-4850-b108-4a4a5412211d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:32.104092 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-c99c82f7-7aa1-4967-9886-408484243a86 req-ac454640-6bf4-4850-b108-4a4a5412211d service nova] Creating event network-vif-deleted:55137242-2e6b-4a3a-a796-20d6c605c358 for instance 88a68a80-f2c4-48c3-ac43-f1e76012f3ea on hv-cinder-81764 Nov 11 20:42:32.108719 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-c99c82f7-7aa1-4967-9886-408484243a86 req-ac454640-6bf4-4850-b108-4a4a5412211d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033256 Nov 11 20:42:32.109491 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 372/871] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:42:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:32.207132 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2f9d7ad5-a6b4-44b7-b76b-115fb683bee6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:32.223018 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2f9d7ad5-a6b4-44b7-b76b-115fb683bee6 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1752 microversion: 2.1 time: 0.356089 Nov 11 20:42:32.223709 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 500/872] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:31 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1752 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:32.401405 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f3afb59f-b061-49e8-ac76-a46d49a0d39c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:32.402097 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f3afb59f-b061-49e8-ac76-a46d49a0d39c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:32.408013 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f3afb59f-b061-49e8-ac76-a46d49a0d39c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:32.408460 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f3afb59f-b061-49e8-ac76-a46d49a0d39c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:32.409235 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f3afb59f-b061-49e8-ac76-a46d49a0d39c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:32.409667 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f3afb59f-b061-49e8-ac76-a46d49a0d39c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:32.424946 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5ef65629-4fab-46fe-b390-88ed96d2ae19 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:32.425800 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5ef65629-4fab-46fe-b390-88ed96d2ae19 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:32.432124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5ef65629-4fab-46fe-b390-88ed96d2ae19 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:32.432918 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5ef65629-4fab-46fe-b390-88ed96d2ae19 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:32.433804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5ef65629-4fab-46fe-b390-88ed96d2ae19 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:32.434338 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5ef65629-4fab-46fe-b390-88ed96d2ae19 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:32.442277 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f3afb59f-b061-49e8-ac76-a46d49a0d39c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:32.443095 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f3afb59f-b061-49e8-ac76-a46d49a0d39c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:32.443220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.objects.instance [None req-f3afb59f-b061-49e8-ac76-a46d49a0d39c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lazy-loading 'fault' on Instance uuid 88a68a80-f2c4-48c3-ac43-f1e76012f3ea {{(pid=122527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:42:32.541150 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f3afb59f-b061-49e8-ac76-a46d49a0d39c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:32.548701 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f3afb59f-b061-49e8-ac76-a46d49a0d39c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 200 len: 1308 microversion: 2.1 time: 0.154138 Nov 11 20:42:32.549385 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 373/873] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:32 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:32.636162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5ef65629-4fab-46fe-b390-88ed96d2ae19 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:32.644042 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5ef65629-4fab-46fe-b390-88ed96d2ae19 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.222746 Nov 11 20:42:32.644605 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 501/874] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:32 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:32.684695 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6034df14-781e-4d74-b987-8c45a7fd83cb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:32.685647 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6034df14-781e-4d74-b987-8c45a7fd83cb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:32.691509 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6034df14-781e-4d74-b987-8c45a7fd83cb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:32.691966 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6034df14-781e-4d74-b987-8c45a7fd83cb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:32.692779 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6034df14-781e-4d74-b987-8c45a7fd83cb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:32.693218 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6034df14-781e-4d74-b987-8c45a7fd83cb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:32.830263 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6034df14-781e-4d74-b987-8c45a7fd83cb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 38084 microversion: 2.1 time: 0.148603 Nov 11 20:42:32.832007 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 374/875] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:32 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 38084 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:42:32.883955 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-76815563-c0fc-4940-8b87-7f456fc9f27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:32.884717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-76815563-c0fc-4940-8b87-7f456fc9f27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:32.890741 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-76815563-c0fc-4940-8b87-7f456fc9f27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:32.891285 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-76815563-c0fc-4940-8b87-7f456fc9f27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:32.892170 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-76815563-c0fc-4940-8b87-7f456fc9f27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:32.892673 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-76815563-c0fc-4940-8b87-7f456fc9f27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:33.037375 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-76815563-c0fc-4940-8b87-7f456fc9f27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:33.047041 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-76815563-c0fc-4940-8b87-7f456fc9f27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:33.048561 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-76815563-c0fc-4940-8b87-7f456fc9f27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:33.049717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-76815563-c0fc-4940-8b87-7f456fc9f27e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.170161 Nov 11 20:42:33.050276 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 502/876] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:32 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:33.091782 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6e00f6d7-f5b2-44a1-9487-245eccf03560 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:33.092658 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6e00f6d7-f5b2-44a1-9487-245eccf03560 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:33.099889 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6e00f6d7-f5b2-44a1-9487-245eccf03560 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:33.100451 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6e00f6d7-f5b2-44a1-9487-245eccf03560 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:33.101836 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6e00f6d7-f5b2-44a1-9487-245eccf03560 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:33.102308 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6e00f6d7-f5b2-44a1-9487-245eccf03560 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:33.232502 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-6e00f6d7-f5b2-44a1-9487-245eccf03560 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:33.241352 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6976b7b5-0f1a-4ff6-ab57-0e2c90bba14a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:33.242825 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6e00f6d7-f5b2-44a1-9487-245eccf03560 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1513 microversion: 2.1 time: 0.154432 Nov 11 20:42:33.242945 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6976b7b5-0f1a-4ff6-ab57-0e2c90bba14a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:33.243556 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 375/877] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:33 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:33.249313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6976b7b5-0f1a-4ff6-ab57-0e2c90bba14a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:33.249961 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6976b7b5-0f1a-4ff6-ab57-0e2c90bba14a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:33.250904 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6976b7b5-0f1a-4ff6-ab57-0e2c90bba14a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:33.251451 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6976b7b5-0f1a-4ff6-ab57-0e2c90bba14a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:33.404918 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6976b7b5-0f1a-4ff6-ab57-0e2c90bba14a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:33.412779 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6976b7b5-0f1a-4ff6-ab57-0e2c90bba14a tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.175110 Nov 11 20:42:33.414579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 503/878] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:33 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:33.566215 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9031a33c-c4a8-46c2-8795-12b0856b022a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:33.566848 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9031a33c-c4a8-46c2-8795-12b0856b022a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: 88a68a80-f2c4-48c3-ac43-f1e76012f3ea] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:33.573214 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9031a33c-c4a8-46c2-8795-12b0856b022a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:33.573662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9031a33c-c4a8-46c2-8795-12b0856b022a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:33.574447 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9031a33c-c4a8-46c2-8795-12b0856b022a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:33.574867 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9031a33c-c4a8-46c2-8795-12b0856b022a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:33.590717 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-9031a33c-c4a8-46c2-8795-12b0856b022a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] HTTP exception thrown: Instance 88a68a80-f2c4-48c3-ac43-f1e76012f3ea could not be found. Nov 11 20:42:33.591291 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9031a33c-c4a8-46c2-8795-12b0856b022a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Returning 404 to user: Instance 88a68a80-f2c4-48c3-ac43-f1e76012f3ea could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:42:33.592128 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9031a33c-c4a8-46c2-8795-12b0856b022a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea" status: 404 len: 111 microversion: 2.1 time: 0.029581 Nov 11 20:42:33.592648 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 376/879] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:33 2021] GET /compute/v2.1/servers/88a68a80-f2c4-48c3-ac43-f1e76012f3ea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:42:33.661333 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-510f7692-c714-445e-b1c0-76e35602afc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:33.661924 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-510f7692-c714-445e-b1c0-76e35602afc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:33.668839 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-510f7692-c714-445e-b1c0-76e35602afc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:33.669281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-510f7692-c714-445e-b1c0-76e35602afc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:33.670055 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-510f7692-c714-445e-b1c0-76e35602afc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:33.670481 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-510f7692-c714-445e-b1c0-76e35602afc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:33.822247 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-510f7692-c714-445e-b1c0-76e35602afc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:33.829951 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-510f7692-c714-445e-b1c0-76e35602afc3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.172295 Nov 11 20:42:33.830507 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 504/880] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:33 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:33.843253 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6448acfa-a80c-4fc2-9b28-77437fd2daf4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:33.844324 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6448acfa-a80c-4fc2-9b28-77437fd2daf4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:33.850830 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6448acfa-a80c-4fc2-9b28-77437fd2daf4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:33.851431 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6448acfa-a80c-4fc2-9b28-77437fd2daf4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:33.852257 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6448acfa-a80c-4fc2-9b28-77437fd2daf4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:33.853417 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6448acfa-a80c-4fc2-9b28-77437fd2daf4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:34.003363 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6448acfa-a80c-4fc2-9b28-77437fd2daf4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 38438 microversion: 2.1 time: 0.163974 Nov 11 20:42:34.006310 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 377/881] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:33 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 38438 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:42:34.068247 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6e57f511-fce0-4063-a80b-2ed327af87a2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:34.068874 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6e57f511-fce0-4063-a80b-2ed327af87a2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:34.075605 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6e57f511-fce0-4063-a80b-2ed327af87a2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:34.076077 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6e57f511-fce0-4063-a80b-2ed327af87a2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:34.076920 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6e57f511-fce0-4063-a80b-2ed327af87a2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:34.077353 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6e57f511-fce0-4063-a80b-2ed327af87a2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:34.208314 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6e57f511-fce0-4063-a80b-2ed327af87a2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:34.216776 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6e57f511-fce0-4063-a80b-2ed327af87a2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:34.218255 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6e57f511-fce0-4063-a80b-2ed327af87a2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:34.219458 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6e57f511-fce0-4063-a80b-2ed327af87a2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.155017 Nov 11 20:42:34.220027 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 505/882] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:34 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:34.261468 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f941006a-9578-4d70-abca-419408652e47 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:34.261845 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f941006a-9578-4d70-abca-419408652e47 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:34.268803 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f941006a-9578-4d70-abca-419408652e47 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:34.269251 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f941006a-9578-4d70-abca-419408652e47 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:34.270105 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f941006a-9578-4d70-abca-419408652e47 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:34.270537 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f941006a-9578-4d70-abca-419408652e47 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:34.409015 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f941006a-9578-4d70-abca-419408652e47 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:34.417103 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f941006a-9578-4d70-abca-419408652e47 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1513 microversion: 2.1 time: 0.161160 Nov 11 20:42:34.417657 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 378/883] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:34 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:34.431046 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e9a867e1-5a98-4c1b-bb0a-9e396498c428 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:34.431648 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e9a867e1-5a98-4c1b-bb0a-9e396498c428 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:34.437544 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e9a867e1-5a98-4c1b-bb0a-9e396498c428 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:34.437987 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e9a867e1-5a98-4c1b-bb0a-9e396498c428 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:34.438759 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e9a867e1-5a98-4c1b-bb0a-9e396498c428 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:34.439186 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e9a867e1-5a98-4c1b-bb0a-9e396498c428 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:34.585613 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e9a867e1-5a98-4c1b-bb0a-9e396498c428 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:34.593320 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e9a867e1-5a98-4c1b-bb0a-9e396498c428 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.166724 Nov 11 20:42:34.593919 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 506/884] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:34 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:34.847399 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-77b34618-9deb-4449-826e-6986cac166d6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:34.848016 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-77b34618-9deb-4449-826e-6986cac166d6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:34.854906 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-77b34618-9deb-4449-826e-6986cac166d6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:34.855355 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-77b34618-9deb-4449-826e-6986cac166d6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:34.856171 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-77b34618-9deb-4449-826e-6986cac166d6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:34.856607 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-77b34618-9deb-4449-826e-6986cac166d6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:34.991082 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-77b34618-9deb-4449-826e-6986cac166d6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:35.004378 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-77b34618-9deb-4449-826e-6986cac166d6 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.160477 Nov 11 20:42:35.004953 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 379/885] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:34 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:35.016108 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3e2ffdad-a03b-435f-9c88-0b2ced8a63aa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:35.017120 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3e2ffdad-a03b-435f-9c88-0b2ced8a63aa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:35.024160 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3e2ffdad-a03b-435f-9c88-0b2ced8a63aa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:35.024722 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3e2ffdad-a03b-435f-9c88-0b2ced8a63aa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:35.025515 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3e2ffdad-a03b-435f-9c88-0b2ced8a63aa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:35.025951 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3e2ffdad-a03b-435f-9c88-0b2ced8a63aa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:35.237940 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-50303aff-dfd9-43e9-9b75-422ed777add4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:35.238540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-50303aff-dfd9-43e9-9b75-422ed777add4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:35.245121 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-50303aff-dfd9-43e9-9b75-422ed777add4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:35.245555 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-50303aff-dfd9-43e9-9b75-422ed777add4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:35.246316 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-50303aff-dfd9-43e9-9b75-422ed777add4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:35.246740 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-50303aff-dfd9-43e9-9b75-422ed777add4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:35.384999 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-50303aff-dfd9-43e9-9b75-422ed777add4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:35.393044 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-50303aff-dfd9-43e9-9b75-422ed777add4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:35.394531 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-50303aff-dfd9-43e9-9b75-422ed777add4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:35.395663 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-50303aff-dfd9-43e9-9b75-422ed777add4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.161424 Nov 11 20:42:35.396244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 380/886] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:35 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:42:35.433749 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c0be2311-4763-4978-b6b2-3c8a0234e033 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:35.434357 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c0be2311-4763-4978-b6b2-3c8a0234e033 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:35.440612 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c0be2311-4763-4978-b6b2-3c8a0234e033 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:35.441057 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c0be2311-4763-4978-b6b2-3c8a0234e033 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:35.441825 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c0be2311-4763-4978-b6b2-3c8a0234e033 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:35.442258 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c0be2311-4763-4978-b6b2-3c8a0234e033 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:35.575167 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c0be2311-4763-4978-b6b2-3c8a0234e033 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:35.582645 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c0be2311-4763-4978-b6b2-3c8a0234e033 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1513 microversion: 2.1 time: 0.152505 Nov 11 20:42:35.583193 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 381/887] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:35 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:35.610239 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2c1e8d8e-d499-47fb-b772-dab3f269c55d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:35.610835 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2c1e8d8e-d499-47fb-b772-dab3f269c55d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:35.617260 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2c1e8d8e-d499-47fb-b772-dab3f269c55d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:35.617854 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2c1e8d8e-d499-47fb-b772-dab3f269c55d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:35.618479 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2c1e8d8e-d499-47fb-b772-dab3f269c55d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:35.618906 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2c1e8d8e-d499-47fb-b772-dab3f269c55d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:35.766747 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-2c1e8d8e-d499-47fb-b772-dab3f269c55d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:35.775363 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2c1e8d8e-d499-47fb-b772-dab3f269c55d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.168537 Nov 11 20:42:35.775860 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 382/888] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:35 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:36.021426 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c7288d12-1eb4-4210-8622-a30ccd7d0b86 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:36.022070 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c7288d12-1eb4-4210-8622-a30ccd7d0b86 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:36.027937 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c7288d12-1eb4-4210-8622-a30ccd7d0b86 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:36.028367 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c7288d12-1eb4-4210-8622-a30ccd7d0b86 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:36.029145 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c7288d12-1eb4-4210-8622-a30ccd7d0b86 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:36.029586 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c7288d12-1eb4-4210-8622-a30ccd7d0b86 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:36.167225 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c7288d12-1eb4-4210-8622-a30ccd7d0b86 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:36.174776 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c7288d12-1eb4-4210-8622-a30ccd7d0b86 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.157082 Nov 11 20:42:36.175322 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 383/889] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:36 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:36.416296 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0da611e8-9033-4349-872b-fadcb9c5ac83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:36.416909 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0da611e8-9033-4349-872b-fadcb9c5ac83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:36.422774 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0da611e8-9033-4349-872b-fadcb9c5ac83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:36.423228 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0da611e8-9033-4349-872b-fadcb9c5ac83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:36.424034 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0da611e8-9033-4349-872b-fadcb9c5ac83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:36.424470 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0da611e8-9033-4349-872b-fadcb9c5ac83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:36.560513 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0da611e8-9033-4349-872b-fadcb9c5ac83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:36.569552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0da611e8-9033-4349-872b-fadcb9c5ac83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:36.571241 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0da611e8-9033-4349-872b-fadcb9c5ac83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:36.572472 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0da611e8-9033-4349-872b-fadcb9c5ac83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.162088 Nov 11 20:42:36.573033 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 384/890] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:36 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:42:36.598355 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7370b896-ab2d-48be-b86c-cc4d0fdf435e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:36.598962 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7370b896-ab2d-48be-b86c-cc4d0fdf435e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:36.606059 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7370b896-ab2d-48be-b86c-cc4d0fdf435e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:36.606515 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7370b896-ab2d-48be-b86c-cc4d0fdf435e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:36.607292 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7370b896-ab2d-48be-b86c-cc4d0fdf435e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:36.607730 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7370b896-ab2d-48be-b86c-cc4d0fdf435e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:36.740051 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7370b896-ab2d-48be-b86c-cc4d0fdf435e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:36.748198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7370b896-ab2d-48be-b86c-cc4d0fdf435e tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1513 microversion: 2.1 time: 0.153250 Nov 11 20:42:36.748954 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 385/891] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:36 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:36.792246 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-12ba0498-5dc0-4cc3-8999-ebc797a8a474 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:36.792854 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-12ba0498-5dc0-4cc3-8999-ebc797a8a474 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:36.799192 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-12ba0498-5dc0-4cc3-8999-ebc797a8a474 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:36.799648 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-12ba0498-5dc0-4cc3-8999-ebc797a8a474 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:36.800645 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-12ba0498-5dc0-4cc3-8999-ebc797a8a474 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:36.801211 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-12ba0498-5dc0-4cc3-8999-ebc797a8a474 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:36.949611 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-12ba0498-5dc0-4cc3-8999-ebc797a8a474 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:36.957514 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-12ba0498-5dc0-4cc3-8999-ebc797a8a474 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.169077 Nov 11 20:42:36.958069 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 386/892] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:36 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:37.097129 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3e2ffdad-a03b-435f-9c88-0b2ced8a63aa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 200 len: 38830 microversion: 2.1 time: 2.084723 Nov 11 20:42:37.097712 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 507/893] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:35 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 38830 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:42:37.107687 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4c81dd54-eb41-4967-b1b0-5be150c2fc3e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:37.108191 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4c81dd54-eb41-4967-b1b0-5be150c2fc3e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:37.114248 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4c81dd54-eb41-4967-b1b0-5be150c2fc3e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:37.114702 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4c81dd54-eb41-4967-b1b0-5be150c2fc3e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:37.115483 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4c81dd54-eb41-4967-b1b0-5be150c2fc3e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:37.115925 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4c81dd54-eb41-4967-b1b0-5be150c2fc3e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:37.139868 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4c81dd54-eb41-4967-b1b0-5be150c2fc3e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/ips" status: 200 len: 144 microversion: 2.1 time: 0.035757 Nov 11 20:42:37.140465 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 387/894] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Nov 11 20:42:37 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:37.192058 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a9f8198e-771f-4903-8dfd-8ea419d0ce54 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:37.192753 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a9f8198e-771f-4903-8dfd-8ea419d0ce54 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:37.200805 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9f8198e-771f-4903-8dfd-8ea419d0ce54 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:37.201282 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9f8198e-771f-4903-8dfd-8ea419d0ce54 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:37.202062 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9f8198e-771f-4903-8dfd-8ea419d0ce54 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:37.202498 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9f8198e-771f-4903-8dfd-8ea419d0ce54 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:37.336742 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a9f8198e-771f-4903-8dfd-8ea419d0ce54 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:37.347884 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a9f8198e-771f-4903-8dfd-8ea419d0ce54 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.159738 Nov 11 20:42:37.348417 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 508/895] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:37 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:37.590786 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a6053118-c89e-4677-8997-c9a9006664ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:37.591389 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a6053118-c89e-4677-8997-c9a9006664ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:37.598392 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a6053118-c89e-4677-8997-c9a9006664ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:37.598777 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a6053118-c89e-4677-8997-c9a9006664ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:37.599551 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a6053118-c89e-4677-8997-c9a9006664ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:37.599996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a6053118-c89e-4677-8997-c9a9006664ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:37.734492 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a6053118-c89e-4677-8997-c9a9006664ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:37.743195 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a6053118-c89e-4677-8997-c9a9006664ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:37.744782 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a6053118-c89e-4677-8997-c9a9006664ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:37.745916 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a6053118-c89e-4677-8997-c9a9006664ed tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.158824 Nov 11 20:42:37.746469 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 388/896] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:37 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:37.765595 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e6a8b0a3-3ebc-4bb5-9eb6-dd81a2b40f00 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:37.766200 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e6a8b0a3-3ebc-4bb5-9eb6-dd81a2b40f00 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:37.772815 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e6a8b0a3-3ebc-4bb5-9eb6-dd81a2b40f00 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:37.773565 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e6a8b0a3-3ebc-4bb5-9eb6-dd81a2b40f00 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:37.774350 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e6a8b0a3-3ebc-4bb5-9eb6-dd81a2b40f00 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:37.774784 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e6a8b0a3-3ebc-4bb5-9eb6-dd81a2b40f00 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:37.952499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e6a8b0a3-3ebc-4bb5-9eb6-dd81a2b40f00 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:37.960858 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e6a8b0a3-3ebc-4bb5-9eb6-dd81a2b40f00 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1513 microversion: 2.1 time: 0.198407 Nov 11 20:42:37.970289 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 509/897] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:37 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:37.975473 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-92bbb502-3790-40b5-9d2a-641e3d3da2d2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:37.976649 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-92bbb502-3790-40b5-9d2a-641e3d3da2d2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:37.984232 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-92bbb502-3790-40b5-9d2a-641e3d3da2d2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:37.984784 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-92bbb502-3790-40b5-9d2a-641e3d3da2d2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:37.985458 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-92bbb502-3790-40b5-9d2a-641e3d3da2d2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:37.985892 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-92bbb502-3790-40b5-9d2a-641e3d3da2d2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:38.248831 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-92bbb502-3790-40b5-9d2a-641e3d3da2d2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:38.257687 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-92bbb502-3790-40b5-9d2a-641e3d3da2d2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.285997 Nov 11 20:42:38.258251 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 389/898] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:37 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:38.364780 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-30e6f802-e915-4ac4-b038-e3553848c124 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:38.365539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-30e6f802-e915-4ac4-b038-e3553848c124 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:38.372680 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-30e6f802-e915-4ac4-b038-e3553848c124 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:38.373123 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-30e6f802-e915-4ac4-b038-e3553848c124 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:38.374010 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-30e6f802-e915-4ac4-b038-e3553848c124 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:38.374627 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-30e6f802-e915-4ac4-b038-e3553848c124 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:38.539495 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-318a392b-7d4c-41dc-b960-e800384ad926 req-77fe8c6b-6358-4ae0-b695-5b7ad5450706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2a29b9-345d-48ed-ab58-999c80cd44d8", "name": "network-vif-deleted", "tag": "a1e7e113-49ef-49f9-9fd9-7534d076360a"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:38.541687 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:42:38.541687 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:42:38.548657 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-318a392b-7d4c-41dc-b960-e800384ad926 req-77fe8c6b-6358-4ae0-b695-5b7ad5450706 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:38.549315 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-318a392b-7d4c-41dc-b960-e800384ad926 req-77fe8c6b-6358-4ae0-b695-5b7ad5450706 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:38.562115 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-318a392b-7d4c-41dc-b960-e800384ad926 req-77fe8c6b-6358-4ae0-b695-5b7ad5450706 service nova] Creating event network-vif-deleted:a1e7e113-49ef-49f9-9fd9-7534d076360a for instance aa2a29b9-345d-48ed-ab58-999c80cd44d8 on hv-cinder-81764 Nov 11 20:42:38.567795 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-318a392b-7d4c-41dc-b960-e800384ad926 req-77fe8c6b-6358-4ae0-b695-5b7ad5450706 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034263 Nov 11 20:42:38.568575 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 390/899] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:42:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:42:38.608541 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-30e6f802-e915-4ac4-b038-e3553848c124 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:38.616638 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-30e6f802-e915-4ac4-b038-e3553848c124 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.255577 Nov 11 20:42:38.617203 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 510/900] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:38 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:38.765582 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-cadf4553-7c9a-4fd2-a460-d8d781c67708 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:38.766224 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-cadf4553-7c9a-4fd2-a460-d8d781c67708 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:38.772440 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cadf4553-7c9a-4fd2-a460-d8d781c67708 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:38.773518 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cadf4553-7c9a-4fd2-a460-d8d781c67708 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:38.774231 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cadf4553-7c9a-4fd2-a460-d8d781c67708 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:38.774662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cadf4553-7c9a-4fd2-a460-d8d781c67708 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:38.911782 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cadf4553-7c9a-4fd2-a460-d8d781c67708 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:38.921032 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cadf4553-7c9a-4fd2-a460-d8d781c67708 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:38.922567 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cadf4553-7c9a-4fd2-a460-d8d781c67708 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:38.923748 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-cadf4553-7c9a-4fd2-a460-d8d781c67708 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.162376 Nov 11 20:42:38.924533 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 391/901] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:38 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:38.977471 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-015a8cee-4d63-4fe9-ad8f-9a6a713b4cc5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:38.978074 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-015a8cee-4d63-4fe9-ad8f-9a6a713b4cc5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:38.984460 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-015a8cee-4d63-4fe9-ad8f-9a6a713b4cc5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:38.984909 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-015a8cee-4d63-4fe9-ad8f-9a6a713b4cc5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:38.985827 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-015a8cee-4d63-4fe9-ad8f-9a6a713b4cc5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:38.986261 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-015a8cee-4d63-4fe9-ad8f-9a6a713b4cc5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:39.018925 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-015a8cee-4d63-4fe9-ad8f-9a6a713b4cc5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:39.019299 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-015a8cee-4d63-4fe9-ad8f-9a6a713b4cc5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:39.019743 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-015a8cee-4d63-4fe9-ad8f-9a6a713b4cc5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lazy-loading 'fault' on Instance uuid aa2a29b9-345d-48ed-ab58-999c80cd44d8 {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:42:39.059124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-015a8cee-4d63-4fe9-ad8f-9a6a713b4cc5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f77c253d448e482db5ecbc453e4e0f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b92a8a05c22447985ae53c7b9c91fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:39.066458 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-015a8cee-4d63-4fe9-ad8f-9a6a713b4cc5 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 200 len: 1308 microversion: 2.1 time: 0.092705 Nov 11 20:42:39.067018 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 511/902] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:38 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:39.279388 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f4afeafe-60c3-4139-854b-1dcf8ff4e717 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:39.280142 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f4afeafe-60c3-4139-854b-1dcf8ff4e717 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:39.286470 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f4afeafe-60c3-4139-854b-1dcf8ff4e717 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:39.287014 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f4afeafe-60c3-4139-854b-1dcf8ff4e717 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:39.288009 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f4afeafe-60c3-4139-854b-1dcf8ff4e717 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:39.288932 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f4afeafe-60c3-4139-854b-1dcf8ff4e717 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:39.441154 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f4afeafe-60c3-4139-854b-1dcf8ff4e717 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:39.449515 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f4afeafe-60c3-4139-854b-1dcf8ff4e717 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.175275 Nov 11 20:42:39.450227 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 392/903] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:39 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:39.633630 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e7617ef9-abe0-4fea-b381-7a6738b4cdd5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:39.634854 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e7617ef9-abe0-4fea-b381-7a6738b4cdd5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:39.640925 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e7617ef9-abe0-4fea-b381-7a6738b4cdd5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:39.641392 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e7617ef9-abe0-4fea-b381-7a6738b4cdd5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:39.642151 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e7617ef9-abe0-4fea-b381-7a6738b4cdd5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:39.642582 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e7617ef9-abe0-4fea-b381-7a6738b4cdd5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:39.779798 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e7617ef9-abe0-4fea-b381-7a6738b4cdd5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:39.787346 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e7617ef9-abe0-4fea-b381-7a6738b4cdd5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.157541 Nov 11 20:42:39.787901 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 512/904] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:39 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:39.942684 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c7aef292-0443-4b6c-a1ac-b75e8cbfad0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:39.943288 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c7aef292-0443-4b6c-a1ac-b75e8cbfad0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:39.949833 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c7aef292-0443-4b6c-a1ac-b75e8cbfad0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:39.950313 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c7aef292-0443-4b6c-a1ac-b75e8cbfad0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:39.951086 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c7aef292-0443-4b6c-a1ac-b75e8cbfad0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:39.951525 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c7aef292-0443-4b6c-a1ac-b75e8cbfad0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:40.081840 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c7aef292-0443-4b6c-a1ac-b75e8cbfad0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:40.084360 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9f3376da-0a38-441f-8d95-a0064c6ebff6 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:40.084972 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9f3376da-0a38-441f-8d95-a0064c6ebff6 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] [instance: aa2a29b9-345d-48ed-ab58-999c80cd44d8] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:40.090946 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c7aef292-0443-4b6c-a1ac-b75e8cbfad0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:40.091277 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9f3376da-0a38-441f-8d95-a0064c6ebff6 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:40.091720 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9f3376da-0a38-441f-8d95-a0064c6ebff6 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:40.092463 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c7aef292-0443-4b6c-a1ac-b75e8cbfad0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:40.092593 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9f3376da-0a38-441f-8d95-a0064c6ebff6 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:40.092972 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9f3376da-0a38-441f-8d95-a0064c6ebff6 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:40.093612 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c7aef292-0443-4b6c-a1ac-b75e8cbfad0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.154630 Nov 11 20:42:40.094169 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 393/905] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:39 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:40.106779 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-9f3376da-0a38-441f-8d95-a0064c6ebff6 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] HTTP exception thrown: Instance aa2a29b9-345d-48ed-ab58-999c80cd44d8 could not be found. Nov 11 20:42:40.107388 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9f3376da-0a38-441f-8d95-a0064c6ebff6 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] Returning 404 to user: Instance aa2a29b9-345d-48ed-ab58-999c80cd44d8 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:42:40.108230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9f3376da-0a38-441f-8d95-a0064c6ebff6 tempest-AttachVolumeNegativeTest-1387964803 tempest-AttachVolumeNegativeTest-1387964803-project] 10.222.0.61 "GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8" status: 404 len: 111 microversion: 2.1 time: 0.027833 Nov 11 20:42:40.108746 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 513/906] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:40 2021] GET /compute/v2.1/servers/aa2a29b9-345d-48ed-ab58-999c80cd44d8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:42:40.467221 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d3c6cfff-7a6d-4b0e-a7b2-172953408a14 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:40.467877 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d3c6cfff-7a6d-4b0e-a7b2-172953408a14 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:40.474054 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d3c6cfff-7a6d-4b0e-a7b2-172953408a14 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:40.474500 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d3c6cfff-7a6d-4b0e-a7b2-172953408a14 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:40.475275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d3c6cfff-7a6d-4b0e-a7b2-172953408a14 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:40.476244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d3c6cfff-7a6d-4b0e-a7b2-172953408a14 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:40.721226 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d3c6cfff-7a6d-4b0e-a7b2-172953408a14 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:40.729488 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d3c6cfff-7a6d-4b0e-a7b2-172953408a14 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.266093 Nov 11 20:42:40.730053 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 394/907] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:40 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:40.804659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-11f82a13-476e-4087-be36-574f510c7d73 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:40.805692 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-11f82a13-476e-4087-be36-574f510c7d73 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:40.811184 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11f82a13-476e-4087-be36-574f510c7d73 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:40.811630 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11f82a13-476e-4087-be36-574f510c7d73 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:40.812616 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11f82a13-476e-4087-be36-574f510c7d73 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:40.813045 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11f82a13-476e-4087-be36-574f510c7d73 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:40.964342 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-11f82a13-476e-4087-be36-574f510c7d73 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:40.971737 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-11f82a13-476e-4087-be36-574f510c7d73 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.171475 Nov 11 20:42:40.972436 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 514/908] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:40 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:41.111659 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5b7b5db8-7e8a-404c-85c0-8ebef6919917 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:41.112297 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5b7b5db8-7e8a-404c-85c0-8ebef6919917 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:41.118972 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b7b5db8-7e8a-404c-85c0-8ebef6919917 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:41.119415 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b7b5db8-7e8a-404c-85c0-8ebef6919917 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:41.120219 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b7b5db8-7e8a-404c-85c0-8ebef6919917 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:41.120647 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b7b5db8-7e8a-404c-85c0-8ebef6919917 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:41.257232 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5b7b5db8-7e8a-404c-85c0-8ebef6919917 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:41.266168 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5b7b5db8-7e8a-404c-85c0-8ebef6919917 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:41.267762 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5b7b5db8-7e8a-404c-85c0-8ebef6919917 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:41.268939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5b7b5db8-7e8a-404c-85c0-8ebef6919917 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.160983 Nov 11 20:42:41.269485 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 395/909] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:41 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:41.747310 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e3897f2f-bbe9-44a6-86dd-3458b871ddba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:41.747907 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e3897f2f-bbe9-44a6-86dd-3458b871ddba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:41.754369 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3897f2f-bbe9-44a6-86dd-3458b871ddba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:41.754991 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3897f2f-bbe9-44a6-86dd-3458b871ddba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:41.755883 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3897f2f-bbe9-44a6-86dd-3458b871ddba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:41.756341 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e3897f2f-bbe9-44a6-86dd-3458b871ddba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:41.899653 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e3897f2f-bbe9-44a6-86dd-3458b871ddba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:41.908230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e3897f2f-bbe9-44a6-86dd-3458b871ddba tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.164417 Nov 11 20:42:41.909000 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 515/910] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:41 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:41.988397 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-86e62219-ec57-422d-a4b4-c8665ad6d413 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:41.989098 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-86e62219-ec57-422d-a4b4-c8665ad6d413 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:41.996941 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-86e62219-ec57-422d-a4b4-c8665ad6d413 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:41.997572 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-86e62219-ec57-422d-a4b4-c8665ad6d413 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:41.998363 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-86e62219-ec57-422d-a4b4-c8665ad6d413 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:41.998888 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-86e62219-ec57-422d-a4b4-c8665ad6d413 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:42.140660 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-86e62219-ec57-422d-a4b4-c8665ad6d413 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:42.148723 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-86e62219-ec57-422d-a4b4-c8665ad6d413 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.163891 Nov 11 20:42:42.149323 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 396/911] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:41 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:42.286646 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a90149db-34b6-4d1b-8983-7149411c14c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:42.287271 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a90149db-34b6-4d1b-8983-7149411c14c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:42.295477 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a90149db-34b6-4d1b-8983-7149411c14c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:42.295953 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a90149db-34b6-4d1b-8983-7149411c14c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:42.296757 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a90149db-34b6-4d1b-8983-7149411c14c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:42.297186 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a90149db-34b6-4d1b-8983-7149411c14c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:42.432966 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a90149db-34b6-4d1b-8983-7149411c14c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:42.441163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a90149db-34b6-4d1b-8983-7149411c14c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:42.442649 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a90149db-34b6-4d1b-8983-7149411c14c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:42.443815 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a90149db-34b6-4d1b-8983-7149411c14c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.160886 Nov 11 20:42:42.444409 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 516/912] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:42 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:42.926643 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7b156edf-81ee-4077-b5a3-f3dec533e3e2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:42.927156 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7b156edf-81ee-4077-b5a3-f3dec533e3e2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:42.933304 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7b156edf-81ee-4077-b5a3-f3dec533e3e2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:42.933750 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7b156edf-81ee-4077-b5a3-f3dec533e3e2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:42.934527 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7b156edf-81ee-4077-b5a3-f3dec533e3e2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:42.934939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7b156edf-81ee-4077-b5a3-f3dec533e3e2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:43.089811 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7b156edf-81ee-4077-b5a3-f3dec533e3e2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:43.099728 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7b156edf-81ee-4077-b5a3-f3dec533e3e2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.176651 Nov 11 20:42:43.100765 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 397/913] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:42 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:43.133198 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bd431c1c-a890-4b4b-b6b1-154a7f271c48 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] Calling method '.version_select at 0x7ff3f2af41f0>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:43.165757 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3d7e2039-46aa-4c88-ba8a-2880223948ab tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:43.166395 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3d7e2039-46aa-4c88-ba8a-2880223948ab tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:43.172310 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3d7e2039-46aa-4c88-ba8a-2880223948ab tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:43.172765 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3d7e2039-46aa-4c88-ba8a-2880223948ab tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:43.173583 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3d7e2039-46aa-4c88-ba8a-2880223948ab tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:43.174010 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3d7e2039-46aa-4c88-ba8a-2880223948ab tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:43.180445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bd431c1c-a890-4b4b-b6b1-154a7f271c48 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2e331b89-e86c-4410-a125-1eae45e86c8d" status: 200 len: 351 microversion: 2.1 time: 0.051565 Nov 11 20:42:43.181097 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 517/914] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:42:43 2021] GET /compute/v2.1/os-volumes/2e331b89-e86c-4410-a125-1eae45e86c8d => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:43.311138 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3d7e2039-46aa-4c88-ba8a-2880223948ab tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:43.321014 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3d7e2039-46aa-4c88-ba8a-2880223948ab tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.157715 Nov 11 20:42:43.322113 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 398/915] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:43 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:43.467991 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4d245762-7b5f-4f06-a0fa-d81ded05094b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:43.468866 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4d245762-7b5f-4f06-a0fa-d81ded05094b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:43.476581 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4d245762-7b5f-4f06-a0fa-d81ded05094b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:43.477112 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4d245762-7b5f-4f06-a0fa-d81ded05094b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:43.477992 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4d245762-7b5f-4f06-a0fa-d81ded05094b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:43.478492 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4d245762-7b5f-4f06-a0fa-d81ded05094b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:43.501780 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-367804033", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "networks": [{"uuid": "7d0e0821-58b7-4378-8e73-122c99e64b79"}]}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:43.555542 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.network.neutron [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] validate_networks() for [('7d0e0821-58b7-4378-8e73-122c99e64b79', None, None, None, None, None)] {{(pid=122527) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:42:43.678166 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4d245762-7b5f-4f06-a0fa-d81ded05094b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:43.687807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4d245762-7b5f-4f06-a0fa-d81ded05094b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:43.689700 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4d245762-7b5f-4f06-a0fa-d81ded05094b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:43.690867 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4d245762-7b5f-4f06-a0fa-d81ded05094b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.227001 Nov 11 20:42:43.691465 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 518/916] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:43 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:43.782765 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-68e6fedf-98e5-4298-99ab-03d7660e9834 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fca51fc9-c775-46e2-9a36-6d66b4712534"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:43.784005 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-68e6fedf-98e5-4298-99ab-03d7660e9834 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:43.790528 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-68e6fedf-98e5-4298-99ab-03d7660e9834 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:43.790967 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-68e6fedf-98e5-4298-99ab-03d7660e9834 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:43.791846 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-68e6fedf-98e5-4298-99ab-03d7660e9834 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:43.792423 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-68e6fedf-98e5-4298-99ab-03d7660e9834 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:43.961240 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Flavor limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:42:43.961958 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Image limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:42:43.962552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Flavor pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:42:43.963058 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Image pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:42:43.963677 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:42:43.973348 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:43.973858 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:43.974877 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:43.975379 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:43.996314 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Getting quotas for project ad9bb6fc32584e87808c292a94dd546d. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:42:44.002314 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Getting quotas for user 6b39b9079633437aad9181c339fee6b6 and project ad9bb6fc32584e87808c292a94dd546d. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:42:44.014732 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Going to run 1 instances... {{(pid=122527) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:42:44.017094 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:42:44.049264 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-68e6fedf-98e5-4298-99ab-03d7660e9834 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270031 Nov 11 20:42:44.050180 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 519/917] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:42:43 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:42:44.069029 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-febe5c62-e0ff-4a3d-8217-bce70ef7626d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573198 Nov 11 20:42:44.070556 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 399/918] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:42:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 11 20:42:44.082256 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-76ffe8de-ff9a-4e94-8d86-1229eb6eb3e6 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:44.083195 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-76ffe8de-ff9a-4e94-8d86-1229eb6eb3e6 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:44.124135 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-25292515-cde4-4670-90e1-5692fdf017e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:44.125435 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-25292515-cde4-4670-90e1-5692fdf017e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:44.131778 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-25292515-cde4-4670-90e1-5692fdf017e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:44.133678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-25292515-cde4-4670-90e1-5692fdf017e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:44.135088 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-25292515-cde4-4670-90e1-5692fdf017e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:44.135848 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-25292515-cde4-4670-90e1-5692fdf017e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:44.157274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-76ffe8de-ff9a-4e94-8d86-1229eb6eb3e6 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:44.166526 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-76ffe8de-ff9a-4e94-8d86-1229eb6eb3e6 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1218 microversion: 2.1 time: 0.089201 Nov 11 20:42:44.167120 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 520/919] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:44 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:44.313353 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-25292515-cde4-4670-90e1-5692fdf017e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:44.321579 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-25292515-cde4-4670-90e1-5692fdf017e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.203040 Nov 11 20:42:44.322262 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 400/920] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:44 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:44.338321 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-05083136-b772-4e98-836a-3e7fe8f80eca tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:44.339072 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-05083136-b772-4e98-836a-3e7fe8f80eca tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:44.347367 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05083136-b772-4e98-836a-3e7fe8f80eca tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:44.348188 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05083136-b772-4e98-836a-3e7fe8f80eca tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:44.349179 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05083136-b772-4e98-836a-3e7fe8f80eca tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:44.349856 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05083136-b772-4e98-836a-3e7fe8f80eca tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:44.517290 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-05083136-b772-4e98-836a-3e7fe8f80eca tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:44.528146 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a1e893f7-8ee6-48bd-92a3-e5574941fe62 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] Calling method '.version_select at 0x7ff3eddecb80>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:44.529383 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-05083136-b772-4e98-836a-3e7fe8f80eca tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.194532 Nov 11 20:42:44.530066 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 521/921] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:44 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:44.568938 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-6d3f15ba-e767-414b-9006-1e7ef06dec5d req-b3c12a6f-c1a6-4933-8ed4-013ed169c852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4a9f51-80d0-4901-beaf-9b03435f002c", "name": "network-vif-plugged", "status": "completed", "tag": "bc0e19f0-bdca-4923-a0c3-77ad0c202bdc"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:44.572014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:42:44.572014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:42:44.581900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-6d3f15ba-e767-414b-9006-1e7ef06dec5d req-b3c12a6f-c1a6-4933-8ed4-013ed169c852 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:44.582783 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-6d3f15ba-e767-414b-9006-1e7ef06dec5d req-b3c12a6f-c1a6-4933-8ed4-013ed169c852 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:44.595924 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-6d3f15ba-e767-414b-9006-1e7ef06dec5d req-b3c12a6f-c1a6-4933-8ed4-013ed169c852 service nova] Creating event network-vif-plugged:bc0e19f0-bdca-4923-a0c3-77ad0c202bdc for instance ce4a9f51-80d0-4901-beaf-9b03435f002c on hv-cinder-81764 Nov 11 20:42:44.596728 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a1e893f7-8ee6-48bd-92a3-e5574941fe62 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/f6f14886-5b51-4b78-b4ba-498797f7c264" status: 200 len: 350 microversion: 2.1 time: 0.073531 Nov 11 20:42:44.597393 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 401/922] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:42:44 2021] GET /compute/v2.1/os-volumes/f6f14886-5b51-4b78-b4ba-498797f7c264 => generated 350 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:44.609975 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-6d3f15ba-e767-414b-9006-1e7ef06dec5d req-b3c12a6f-c1a6-4933-8ed4-013ed169c852 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045837 Nov 11 20:42:44.611512 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 522/923] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:42:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:44.711102 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-26513bb7-0e2b-4b45-8768-585c527c555b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:44.713797 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-26513bb7-0e2b-4b45-8768-585c527c555b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:44.722396 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-26513bb7-0e2b-4b45-8768-585c527c555b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:44.722781 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-26513bb7-0e2b-4b45-8768-585c527c555b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:44.724485 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-26513bb7-0e2b-4b45-8768-585c527c555b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:44.724968 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-26513bb7-0e2b-4b45-8768-585c527c555b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:44.890409 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-26513bb7-0e2b-4b45-8768-585c527c555b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:44.902689 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-26513bb7-0e2b-4b45-8768-585c527c555b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:44.902689 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-26513bb7-0e2b-4b45-8768-585c527c555b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:44.902689 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-26513bb7-0e2b-4b45-8768-585c527c555b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.196306 Nov 11 20:42:44.903806 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 402/924] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:44 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:45.183257 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a3ecc7a0-9e27-4136-8add-0110e8cd8110 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:45.184115 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a3ecc7a0-9e27-4136-8add-0110e8cd8110 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:45.190163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a3ecc7a0-9e27-4136-8add-0110e8cd8110 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:45.190603 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a3ecc7a0-9e27-4136-8add-0110e8cd8110 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:45.191373 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a3ecc7a0-9e27-4136-8add-0110e8cd8110 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:45.191795 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a3ecc7a0-9e27-4136-8add-0110e8cd8110 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:45.266055 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a3ecc7a0-9e27-4136-8add-0110e8cd8110 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:45.276060 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a3ecc7a0-9e27-4136-8add-0110e8cd8110 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1270 microversion: 2.1 time: 0.097057 Nov 11 20:42:45.276709 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 523/925] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:45 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:45.338986 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-cb9d44f0-ae4d-44f5-a988-a25daaf2b538 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:45.339593 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-cb9d44f0-ae4d-44f5-a988-a25daaf2b538 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:45.349704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cb9d44f0-ae4d-44f5-a988-a25daaf2b538 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:45.350424 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cb9d44f0-ae4d-44f5-a988-a25daaf2b538 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:45.351441 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cb9d44f0-ae4d-44f5-a988-a25daaf2b538 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:45.352065 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cb9d44f0-ae4d-44f5-a988-a25daaf2b538 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:45.546974 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-83f463ce-4d46-479e-b59f-d1bc4b6f5df2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:45.547203 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-83f463ce-4d46-479e-b59f-d1bc4b6f5df2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:45.553147 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-83f463ce-4d46-479e-b59f-d1bc4b6f5df2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:45.553597 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-83f463ce-4d46-479e-b59f-d1bc4b6f5df2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:45.554476 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-83f463ce-4d46-479e-b59f-d1bc4b6f5df2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:45.554778 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cb9d44f0-ae4d-44f5-a988-a25daaf2b538 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:45.555111 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-83f463ce-4d46-479e-b59f-d1bc4b6f5df2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:45.563101 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-cb9d44f0-ae4d-44f5-a988-a25daaf2b538 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.228183 Nov 11 20:42:45.564012 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 403/926] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:45 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:45.690402 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-83f463ce-4d46-479e-b59f-d1bc4b6f5df2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:45.700477 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-83f463ce-4d46-479e-b59f-d1bc4b6f5df2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.157498 Nov 11 20:42:45.701087 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 524/927] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:45 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:45.920825 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-66d803ba-e225-45d3-8bba-fa17c541ecfe tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:45.921666 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-66d803ba-e225-45d3-8bba-fa17c541ecfe tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:45.928906 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-66d803ba-e225-45d3-8bba-fa17c541ecfe tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:45.929346 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-66d803ba-e225-45d3-8bba-fa17c541ecfe tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:45.930215 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-66d803ba-e225-45d3-8bba-fa17c541ecfe tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:45.933212 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-66d803ba-e225-45d3-8bba-fa17c541ecfe tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:45.971848 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-57fc35c7-d4c0-41b9-b9f5-502444c1c7a8 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] Calling method '.version_select at 0x7ff3ed973820>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:46.022366 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-57fc35c7-d4c0-41b9-b9f5-502444c1c7a8 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5f94b70-0ab7-42a4-b126-b50a5632af2d" status: 200 len: 350 microversion: 2.1 time: 0.060415 Nov 11 20:42:46.023960 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 525/928] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:42:45 2021] GET /compute/v2.1/os-volumes/b5f94b70-0ab7-42a4-b126-b50a5632af2d => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:42:46.036004 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c2db3008-a1ff-404c-9625-ae4ae982e0d9 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] Calling method '.version_select at 0x7ff3f2af48b0>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:46.134514 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c2db3008-a1ff-404c-9625-ae4ae982e0d9 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.102158 Nov 11 20:42:46.142491 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 526/929] 10.222.0.61 () {58 vars in 1133 bytes} [Thu Nov 11 20:42:46 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:46.147147 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-dbb68396-d3a6-464c-a20b-bacb1da2467c tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] Calling method '.version_select at 0x7ff3ed973310>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:46.243792 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-dbb68396-d3a6-464c-a20b-bacb1da2467c tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.098788 Nov 11 20:42:46.244445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 527/930] 10.222.0.61 () {58 vars in 1148 bytes} [Thu Nov 11 20:42:46 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:46.256307 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-92400436-3956-4ff5-b86b-5fb5a01cba66 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] Calling method '.version_select at 0x7ff3f2af2670>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:46.332834 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-66d803ba-e225-45d3-8bba-fa17c541ecfe tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:46.345955 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-66d803ba-e225-45d3-8bba-fa17c541ecfe tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:46.348262 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-66d803ba-e225-45d3-8bba-fa17c541ecfe tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:46.348406 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-92400436-3956-4ff5-b86b-5fb5a01cba66 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095353 Nov 11 20:42:46.349483 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 528/931] 10.222.0.61 () {58 vars in 1133 bytes} [Thu Nov 11 20:42:46 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:46.350052 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-66d803ba-e225-45d3-8bba-fa17c541ecfe tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.432994 Nov 11 20:42:46.360267 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bb17d02b-74c9-4b5f-a401-455df2c0040c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:46.360267 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-bb17d02b-74c9-4b5f-a401-455df2c0040c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:46.360862 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 404/932] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:45 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:46.365770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bb17d02b-74c9-4b5f-a401-455df2c0040c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:46.366023 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-93ddf16f-6cad-4739-9598-47eb02d83c26 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] Calling method '.version_select at 0x7ff3eda5a040>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:46.367204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bb17d02b-74c9-4b5f-a401-455df2c0040c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:46.368274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bb17d02b-74c9-4b5f-a401-455df2c0040c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:46.368973 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bb17d02b-74c9-4b5f-a401-455df2c0040c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:46.444937 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-bb17d02b-74c9-4b5f-a401-455df2c0040c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:46.450393 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-93ddf16f-6cad-4739-9598-47eb02d83c26 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088263 Nov 11 20:42:46.451486 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 405/933] 10.222.0.61 () {58 vars in 1166 bytes} [Thu Nov 11 20:42:46 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:46.455040 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bb17d02b-74c9-4b5f-a401-455df2c0040c tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1276 microversion: 2.1 time: 0.104500 Nov 11 20:42:46.455598 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 529/934] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:46 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:46.466237 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3299e1cb-f967-4cad-9b73-9dd2de5f878c tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] Calling method '.version_select at 0x7ff3eda715e0>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:46.547897 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3299e1cb-f967-4cad-9b73-9dd2de5f878c tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086249 Nov 11 20:42:46.548499 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 406/935] 10.222.0.61 () {58 vars in 1169 bytes} [Thu Nov 11 20:42:46 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:46.561602 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d20967f2-f214-41c2-bafa-435640f7bccc tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] Calling method '.version_select at 0x7ff3f2a89e50>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:46.579608 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3fd3bca0-e22c-472b-84b0-64dbb3488b54 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:46.580232 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3fd3bca0-e22c-472b-84b0-64dbb3488b54 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:46.589110 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3fd3bca0-e22c-472b-84b0-64dbb3488b54 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:46.589570 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3fd3bca0-e22c-472b-84b0-64dbb3488b54 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:46.590365 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3fd3bca0-e22c-472b-84b0-64dbb3488b54 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:46.590987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3fd3bca0-e22c-472b-84b0-64dbb3488b54 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:46.646594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d20967f2-f214-41c2-bafa-435640f7bccc tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088548 Nov 11 20:42:46.648050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 530/936] 10.222.0.61 () {58 vars in 1154 bytes} [Thu Nov 11 20:42:46 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:46.660725 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2cf2806f-d923-45b4-8ca3-c73ba7e0f5c2 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] Calling method '.version_select at 0x7ff3ee460700>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:46.746661 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2cf2806f-d923-45b4-8ca3-c73ba7e0f5c2 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089434 Nov 11 20:42:46.747405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 531/937] 10.222.0.61 () {58 vars in 1187 bytes} [Thu Nov 11 20:42:46 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:46.758586 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-89414ebd-5302-48ee-b8d8-afb42093c460 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:46.759194 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-89414ebd-5302-48ee-b8d8-afb42093c460 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:46.767722 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-89414ebd-5302-48ee-b8d8-afb42093c460 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:46.768213 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-89414ebd-5302-48ee-b8d8-afb42093c460 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:46.769005 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-89414ebd-5302-48ee-b8d8-afb42093c460 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:46.769440 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-89414ebd-5302-48ee-b8d8-afb42093c460 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:46.909568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3fd3bca0-e22c-472b-84b0-64dbb3488b54 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:46.918489 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3fd3bca0-e22c-472b-84b0-64dbb3488b54 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.342384 Nov 11 20:42:46.919314 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 407/938] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:46 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:46.923545 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4a861bf1-7d2e-4257-a0ad-e09c73dd9ef4 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] Calling method '.version_select at 0x7ff3eda0f820>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:47.017083 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4a861bf1-7d2e-4257-a0ad-e09c73dd9ef4 tempest-VolumesTestJSON-697326781 tempest-VolumesTestJSON-697326781-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.096639 Nov 11 20:42:47.017657 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 408/939] 10.222.0.61 () {58 vars in 1154 bytes} [Thu Nov 11 20:42:46 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:47.067250 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-89414ebd-5302-48ee-b8d8-afb42093c460 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:47.076347 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-89414ebd-5302-48ee-b8d8-afb42093c460 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.321178 Nov 11 20:42:47.077349 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 532/940] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:46 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:47.370114 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9bc4dfd5-74df-4a54-9345-b5d5d2ef4643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:47.370819 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9bc4dfd5-74df-4a54-9345-b5d5d2ef4643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:47.378123 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9bc4dfd5-74df-4a54-9345-b5d5d2ef4643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:47.378948 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9bc4dfd5-74df-4a54-9345-b5d5d2ef4643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:47.379939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9bc4dfd5-74df-4a54-9345-b5d5d2ef4643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:47.380402 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9bc4dfd5-74df-4a54-9345-b5d5d2ef4643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:47.474630 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2345524d-eede-42e2-9265-357b4cd6ab11 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:47.475252 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2345524d-eede-42e2-9265-357b4cd6ab11 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:47.482928 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2345524d-eede-42e2-9265-357b4cd6ab11 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:47.483383 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2345524d-eede-42e2-9265-357b4cd6ab11 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:47.484253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2345524d-eede-42e2-9265-357b4cd6ab11 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:47.484686 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2345524d-eede-42e2-9265-357b4cd6ab11 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:47.660760 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9bc4dfd5-74df-4a54-9345-b5d5d2ef4643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:47.681483 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9bc4dfd5-74df-4a54-9345-b5d5d2ef4643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:47.683675 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9bc4dfd5-74df-4a54-9345-b5d5d2ef4643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:47.688463 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9bc4dfd5-74df-4a54-9345-b5d5d2ef4643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1808 microversion: 2.20 time: 0.322941 Nov 11 20:42:47.701462 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 409/941] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:47 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1808 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:47.707023 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-2473c28f-fd40-4549-ad13-3bfe3ad8a282 req-b25f884e-44d8-478b-bf63-968298bc4f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e8e904-4a99-4f15-bb67-de6de15ca227", "tag": "264d6612-f400-47b2-8c4e-bdd88f54e280"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:47.709424 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:42:47.709424 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:42:47.719680 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-2473c28f-fd40-4549-ad13-3bfe3ad8a282 req-b25f884e-44d8-478b-bf63-968298bc4f56 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:47.720363 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-2473c28f-fd40-4549-ad13-3bfe3ad8a282 req-b25f884e-44d8-478b-bf63-968298bc4f56 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:47.735117 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-2473c28f-fd40-4549-ad13-3bfe3ad8a282 req-b25f884e-44d8-478b-bf63-968298bc4f56 service nova] Creating event network-changed:264d6612-f400-47b2-8c4e-bdd88f54e280 for instance f8e8e904-4a99-4f15-bb67-de6de15ca227 on hv-cinder-81764 Nov 11 20:42:47.744346 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-2473c28f-fd40-4549-ad13-3bfe3ad8a282 req-b25f884e-44d8-478b-bf63-968298bc4f56 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041085 Nov 11 20:42:47.744956 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 410/942] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:42:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:47.784583 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2345524d-eede-42e2-9265-357b4cd6ab11 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:47.792698 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2345524d-eede-42e2-9265-357b4cd6ab11 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1318 microversion: 2.1 time: 0.323446 Nov 11 20:42:47.795668 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 533/943] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:47 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:47.937053 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-16c5bf78-3098-4b80-ae10-9759d59155bc tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:47.937987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-16c5bf78-3098-4b80-ae10-9759d59155bc tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:47.945081 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-16c5bf78-3098-4b80-ae10-9759d59155bc tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:47.945540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-16c5bf78-3098-4b80-ae10-9759d59155bc tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:47.946624 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-16c5bf78-3098-4b80-ae10-9759d59155bc tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:47.947059 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-16c5bf78-3098-4b80-ae10-9759d59155bc tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:48.098099 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-41b5390a-647a-4435-81c4-3a9ae4b2e344 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:48.098707 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-41b5390a-647a-4435-81c4-3a9ae4b2e344 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:48.106325 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-41b5390a-647a-4435-81c4-3a9ae4b2e344 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:48.107121 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-41b5390a-647a-4435-81c4-3a9ae4b2e344 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:48.108226 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-41b5390a-647a-4435-81c4-3a9ae4b2e344 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:48.109050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-41b5390a-647a-4435-81c4-3a9ae4b2e344 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:48.303018 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-16c5bf78-3098-4b80-ae10-9759d59155bc tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:48.312859 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-16c5bf78-3098-4b80-ae10-9759d59155bc tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.379919 Nov 11 20:42:48.313566 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 411/944] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:47 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:48.393237 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-41b5390a-647a-4435-81c4-3a9ae4b2e344 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:48.401889 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-41b5390a-647a-4435-81c4-3a9ae4b2e344 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.307379 Nov 11 20:42:48.402494 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 534/945] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:48 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:48.708022 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f61ce3ac-6bdd-45a6-aa45-5305c67ce814 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:48.709459 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f61ce3ac-6bdd-45a6-aa45-5305c67ce814 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:48.717369 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f61ce3ac-6bdd-45a6-aa45-5305c67ce814 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:48.717819 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f61ce3ac-6bdd-45a6-aa45-5305c67ce814 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:48.718609 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f61ce3ac-6bdd-45a6-aa45-5305c67ce814 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:48.719045 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f61ce3ac-6bdd-45a6-aa45-5305c67ce814 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:48.812114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8639cb53-42d1-4ae2-a986-e1c7b791df9d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:48.812722 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8639cb53-42d1-4ae2-a986-e1c7b791df9d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:48.819332 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8639cb53-42d1-4ae2-a986-e1c7b791df9d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:48.821290 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8639cb53-42d1-4ae2-a986-e1c7b791df9d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:48.822118 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8639cb53-42d1-4ae2-a986-e1c7b791df9d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:48.822561 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8639cb53-42d1-4ae2-a986-e1c7b791df9d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:48.998479 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f61ce3ac-6bdd-45a6-aa45-5305c67ce814 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:49.009268 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f61ce3ac-6bdd-45a6-aa45-5305c67ce814 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:49.011287 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f61ce3ac-6bdd-45a6-aa45-5305c67ce814 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:49.013223 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f61ce3ac-6bdd-45a6-aa45-5305c67ce814 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1795 microversion: 2.20 time: 0.309779 Nov 11 20:42:49.023520 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 412/946] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:42:48 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1795 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:42:49.075638 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8639cb53-42d1-4ae2-a986-e1c7b791df9d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:49.083682 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8639cb53-42d1-4ae2-a986-e1c7b791df9d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1318 microversion: 2.1 time: 0.275195 Nov 11 20:42:49.084337 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 535/947] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:48 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:49.331413 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5d3370d7-67dd-4370-ad02-c0cf09d3f454 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:49.332391 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5d3370d7-67dd-4370-ad02-c0cf09d3f454 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:49.340016 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d3370d7-67dd-4370-ad02-c0cf09d3f454 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:49.343163 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d3370d7-67dd-4370-ad02-c0cf09d3f454 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:49.343163 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d3370d7-67dd-4370-ad02-c0cf09d3f454 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:49.343163 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5d3370d7-67dd-4370-ad02-c0cf09d3f454 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:49.419679 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7bc105be-ea26-44d2-8fe6-2efc8c5046a2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:49.420420 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7bc105be-ea26-44d2-8fe6-2efc8c5046a2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:49.426738 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7bc105be-ea26-44d2-8fe6-2efc8c5046a2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:49.427296 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7bc105be-ea26-44d2-8fe6-2efc8c5046a2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:49.428313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7bc105be-ea26-44d2-8fe6-2efc8c5046a2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:49.428860 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7bc105be-ea26-44d2-8fe6-2efc8c5046a2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:49.543718 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5d3370d7-67dd-4370-ad02-c0cf09d3f454 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:49.553153 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5d3370d7-67dd-4370-ad02-c0cf09d3f454 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.226199 Nov 11 20:42:49.554021 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 413/948] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:49 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:49.610073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7bc105be-ea26-44d2-8fe6-2efc8c5046a2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:49.618029 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7bc105be-ea26-44d2-8fe6-2efc8c5046a2 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.202180 Nov 11 20:42:49.618596 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 536/949] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:49 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:50.101412 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-542e66c3-6b5d-424c-b475-5e37bfc1bdd1 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:50.102263 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-542e66c3-6b5d-424c-b475-5e37bfc1bdd1 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:50.108596 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-542e66c3-6b5d-424c-b475-5e37bfc1bdd1 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:50.109081 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-542e66c3-6b5d-424c-b475-5e37bfc1bdd1 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:50.110289 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-542e66c3-6b5d-424c-b475-5e37bfc1bdd1 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:50.110724 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-542e66c3-6b5d-424c-b475-5e37bfc1bdd1 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:50.251928 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-542e66c3-6b5d-424c-b475-5e37bfc1bdd1 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:50.259665 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-542e66c3-6b5d-424c-b475-5e37bfc1bdd1 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1318 microversion: 2.1 time: 0.162031 Nov 11 20:42:50.260261 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 414/950] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:50 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:50.571951 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-922f5a9e-1d57-4fc2-919e-227e0d7d876f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:50.572587 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-922f5a9e-1d57-4fc2-919e-227e0d7d876f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:50.578752 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-922f5a9e-1d57-4fc2-919e-227e0d7d876f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:50.579197 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-922f5a9e-1d57-4fc2-919e-227e0d7d876f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:50.579992 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-922f5a9e-1d57-4fc2-919e-227e0d7d876f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:50.580433 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-922f5a9e-1d57-4fc2-919e-227e0d7d876f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:50.636705 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2a3e6e09-1a74-4c7c-b5d7-b0b4c6753c02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:50.638197 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2a3e6e09-1a74-4c7c-b5d7-b0b4c6753c02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:50.652762 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2a3e6e09-1a74-4c7c-b5d7-b0b4c6753c02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:50.653227 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2a3e6e09-1a74-4c7c-b5d7-b0b4c6753c02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:50.653999 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2a3e6e09-1a74-4c7c-b5d7-b0b4c6753c02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:50.654613 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2a3e6e09-1a74-4c7c-b5d7-b0b4c6753c02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:50.762601 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-922f5a9e-1d57-4fc2-919e-227e0d7d876f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:50.771266 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-922f5a9e-1d57-4fc2-919e-227e0d7d876f tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.204033 Nov 11 20:42:50.772494 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 537/951] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:50 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:50.824808 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-2a3e6e09-1a74-4c7c-b5d7-b0b4c6753c02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:50.833283 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2a3e6e09-1a74-4c7c-b5d7-b0b4c6753c02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1568 microversion: 2.1 time: 0.201942 Nov 11 20:42:50.833961 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 415/952] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:50 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:51.276133 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ece0e39f-1666-456c-930b-d8b27b173462 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:51.276741 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ece0e39f-1666-456c-930b-d8b27b173462 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:51.282609 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ece0e39f-1666-456c-930b-d8b27b173462 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:51.283149 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ece0e39f-1666-456c-930b-d8b27b173462 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:51.284016 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ece0e39f-1666-456c-930b-d8b27b173462 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:51.284544 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ece0e39f-1666-456c-930b-d8b27b173462 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:51.420574 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ece0e39f-1666-456c-930b-d8b27b173462 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:51.428541 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ece0e39f-1666-456c-930b-d8b27b173462 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1318 microversion: 2.1 time: 0.156112 Nov 11 20:42:51.434139 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 538/953] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:51 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:51.762571 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-794fecbe-05eb-4380-ad9c-f2298c09bdc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:51.768883 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-794fecbe-05eb-4380-ad9c-f2298c09bdc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:51.769331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-794fecbe-05eb-4380-ad9c-f2298c09bdc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:51.805622 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0a53065d-79e2-4c05-8130-74f2a7838725 tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] Action: 'create', calling method: .version_select at 0x7ff3eda71e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1059978054", "metadata": {"Type": "work"}}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:51.807060 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0a53065d-79e2-4c05-8130-74f2a7838725 tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:42:51.807855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0a53065d-79e2-4c05-8130-74f2a7838725 tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.123660 Nov 11 20:42:51.808754 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 416/954] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Nov 11 20:42:51 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 11 20:42:51.813355 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d4d3fee2-6aae-4bc7-bad6-86d92e659ce1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:51.813956 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d4d3fee2-6aae-4bc7-bad6-86d92e659ce1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:51.824376 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d4d3fee2-6aae-4bc7-bad6-86d92e659ce1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:51.824833 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d4d3fee2-6aae-4bc7-bad6-86d92e659ce1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:51.825804 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d4d3fee2-6aae-4bc7-bad6-86d92e659ce1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:51.827541 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d4d3fee2-6aae-4bc7-bad6-86d92e659ce1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:51.839579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-794fecbe-05eb-4380-ad9c-f2298c09bdc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Going to try to stop instance {{(pid=122526) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 11 20:42:51.891843 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-794fecbe-05eb-4380-ad9c-f2298c09bdc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 202 len: 0 microversion: 2.1 time: 0.132741 Nov 11 20:42:51.892407 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 539/955] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:51 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:42:51.897502 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-238491f4-f151-447f-be0f-302fc0aacd2b tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] Action: 'create', calling method: .version_select at 0x7ff3ee5d29d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2076250483", "metadata": {"Type": "work"}}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:51.900382 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-238491f4-f151-447f-be0f-302fc0aacd2b tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:42:51.901203 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-238491f4-f151-447f-be0f-302fc0aacd2b tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007723 Nov 11 20:42:51.901761 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 540/956] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Nov 11 20:42:51 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 11 20:42:51.914446 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-241bdf4c-eabc-4296-817f-4c5d3f24311f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:51.915203 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-241bdf4c-eabc-4296-817f-4c5d3f24311f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:51.922593 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-241bdf4c-eabc-4296-817f-4c5d3f24311f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:51.923048 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-241bdf4c-eabc-4296-817f-4c5d3f24311f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:51.923873 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-241bdf4c-eabc-4296-817f-4c5d3f24311f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:51.924338 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-241bdf4c-eabc-4296-817f-4c5d3f24311f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:52.021415 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d4d3fee2-6aae-4bc7-bad6-86d92e659ce1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:52.029951 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d4d3fee2-6aae-4bc7-bad6-86d92e659ce1 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.219911 Nov 11 20:42:52.030515 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 417/957] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:51 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:52.039760 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e2c3e695-c931-41b4-a0d4-a08a464e6063 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:52.040389 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e2c3e695-c931-41b4-a0d4-a08a464e6063 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:52.046082 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e2c3e695-c931-41b4-a0d4-a08a464e6063 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:52.046528 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e2c3e695-c931-41b4-a0d4-a08a464e6063 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:52.047296 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e2c3e695-c931-41b4-a0d4-a08a464e6063 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:52.047725 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e2c3e695-c931-41b4-a0d4-a08a464e6063 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:52.091116 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-241bdf4c-eabc-4296-817f-4c5d3f24311f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:52.099439 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-241bdf4c-eabc-4296-817f-4c5d3f24311f tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1548 microversion: 2.1 time: 0.196713 Nov 11 20:42:52.100028 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 541/958] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:51 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:52.104724 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e783de2d-7a5c-4605-a0e0-78a8a29a59b8 tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] Action: 'create', calling method: .version_select at 0x7ff3ed97f160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-420156837", "metadata": {"Type": "work"}}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:52.105964 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e783de2d-7a5c-4605-a0e0-78a8a29a59b8 tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:42:52.106797 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e783de2d-7a5c-4605-a0e0-78a8a29a59b8 tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005835 Nov 11 20:42:52.107328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 542/959] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Nov 11 20:42:52 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 11 20:42:52.115644 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b34a4ca1-fdc4-4033-9355-0ab3e9f74975 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:52.116311 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b34a4ca1-fdc4-4033-9355-0ab3e9f74975 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:52.123349 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b34a4ca1-fdc4-4033-9355-0ab3e9f74975 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:52.123801 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b34a4ca1-fdc4-4033-9355-0ab3e9f74975 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:52.124607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b34a4ca1-fdc4-4033-9355-0ab3e9f74975 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:52.125123 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b34a4ca1-fdc4-4033-9355-0ab3e9f74975 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:52.197004 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e2c3e695-c931-41b4-a0d4-a08a464e6063 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:52.204965 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e2c3e695-c931-41b4-a0d4-a08a464e6063 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.168987 Nov 11 20:42:52.205624 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 418/960] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:52 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:52.211071 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b0f84965-2a9b-406f-bdd6-08ed2bd5d19f tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] Calling method '.version_select at 0x7ff3eda718b0>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:52.220666 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-b34a4ca1-fdc4-4033-9355-0ab3e9f74975 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] HTTP exception thrown: Cannot 'detach_volume' instance ddd75246-98f4-4479-be99-f39c6427cc92 while it is in vm_state rescued Nov 11 20:42:52.221266 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b34a4ca1-fdc4-4033-9355-0ab3e9f74975 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Returning 409 to user: Cannot 'detach_volume' instance ddd75246-98f4-4479-be99-f39c6427cc92 while it is in vm_state rescued {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:42:52.222136 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b34a4ca1-fdc4-4033-9355-0ab3e9f74975 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments/c5be2936-3d74-42c2-9f7d-2d5684aeddc4" status: 409 len: 152 microversion: 2.1 time: 0.109981 Nov 11 20:42:52.222684 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 543/961] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Nov 11 20:42:52 2021] DELETE /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments/c5be2936-3d74-42c2-9f7d-2d5684aeddc4 => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 11 20:42:52.231930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f18164d3-b875-49ee-8c1b-c81e3f04200d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:52.232498 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f18164d3-b875-49ee-8c1b-c81e3f04200d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:52.238268 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f18164d3-b875-49ee-8c1b-c81e3f04200d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:52.238717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f18164d3-b875-49ee-8c1b-c81e3f04200d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:52.239497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f18164d3-b875-49ee-8c1b-c81e3f04200d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:52.239606 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-b0f84965-2a9b-406f-bdd6-08ed2bd5d19f tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] HTTP exception thrown: Volume tempest-invalid-929999424 could not be found. Nov 11 20:42:52.239931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f18164d3-b875-49ee-8c1b-c81e3f04200d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:52.240156 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b0f84965-2a9b-406f-bdd6-08ed2bd5d19f tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] Returning 404 to user: Volume tempest-invalid-929999424 could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:42:52.240997 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b0f84965-2a9b-406f-bdd6-08ed2bd5d19f tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-929999424" status: 404 len: 98 microversion: 2.1 time: 0.034072 Nov 11 20:42:52.241643 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 419/962] 10.222.0.61 () {58 vars in 1214 bytes} [Thu Nov 11 20:42:52 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-929999424 => generated 98 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 11 20:42:52.251369 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e4aecf0f-4504-4d74-afd7-5e6a5ee61a01 tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003719 Nov 11 20:42:52.251913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 420/963] 10.222.0.61 () {58 vars in 1139 bytes} [Thu Nov 11 20:42:52 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 11 20:42:52.260090 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5b6495a9-e314-449d-b349-1206e88a1473 tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003414 Nov 11 20:42:52.260632 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 421/964] 10.222.0.61 () {58 vars in 1136 bytes} [Thu Nov 11 20:42:52 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 11 20:42:52.268970 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-89bd47ab-4925-440c-93a8-08a7392e4bb9 tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] Calling method '.version_select at 0x7ff3edaba9d0>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:52.298851 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-89bd47ab-4925-440c-93a8-08a7392e4bb9 tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] HTTP exception thrown: Volume 316805cb-ff64-48d2-b15e-dadc743aca4f could not be found. Nov 11 20:42:52.299469 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-89bd47ab-4925-440c-93a8-08a7392e4bb9 tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] Returning 404 to user: Volume 316805cb-ff64-48d2-b15e-dadc743aca4f could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:42:52.300406 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-89bd47ab-4925-440c-93a8-08a7392e4bb9 tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/316805cb-ff64-48d2-b15e-dadc743aca4f" status: 404 len: 109 microversion: 2.1 time: 0.034884 Nov 11 20:42:52.300952 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 422/965] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Nov 11 20:42:52 2021] DELETE /compute/v2.1/os-volumes/316805cb-ff64-48d2-b15e-dadc743aca4f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 11 20:42:52.310766 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8d94fe6d-cf2b-4c35-a704-e3d9efbc42eb tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] Calling method '.version_select at 0x7ff3edaf1280>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:52.312050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f18164d3-b875-49ee-8c1b-c81e3f04200d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "POST /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/action" status: 202 len: 0 microversion: 2.1 time: 0.083482 Nov 11 20:42:52.312852 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 544/966] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:42:52 2021] POST /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:42:52.321986 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cce3ab3d-04d4-4c3f-84ac-84d9693660f9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:52.322692 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cce3ab3d-04d4-4c3f-84ac-84d9693660f9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:52.329647 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cce3ab3d-04d4-4c3f-84ac-84d9693660f9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:52.330186 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cce3ab3d-04d4-4c3f-84ac-84d9693660f9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:52.331179 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cce3ab3d-04d4-4c3f-84ac-84d9693660f9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:52.331609 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cce3ab3d-04d4-4c3f-84ac-84d9693660f9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:52.342924 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-8d94fe6d-cf2b-4c35-a704-e3d9efbc42eb tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] HTTP exception thrown: Volume 0b35e6f1-fae0-4baf-8c21-53bc4ea87fdd could not be found. Nov 11 20:42:52.343776 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8d94fe6d-cf2b-4c35-a704-e3d9efbc42eb tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] Returning 404 to user: Volume 0b35e6f1-fae0-4baf-8c21-53bc4ea87fdd could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:42:52.344689 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8d94fe6d-cf2b-4c35-a704-e3d9efbc42eb tempest-VolumesNegativeTest-1422563125 tempest-VolumesNegativeTest-1422563125-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0b35e6f1-fae0-4baf-8c21-53bc4ea87fdd" status: 404 len: 109 microversion: 2.1 time: 0.037818 Nov 11 20:42:52.345283 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 423/967] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:42:52 2021] GET /compute/v2.1/os-volumes/0b35e6f1-fae0-4baf-8c21-53bc4ea87fdd => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 11 20:42:52.447369 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-432358ae-6a9b-467d-a2b4-b9b349d22e1d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:52.448443 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-432358ae-6a9b-467d-a2b4-b9b349d22e1d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:52.456587 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-432358ae-6a9b-467d-a2b4-b9b349d22e1d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:52.457434 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-432358ae-6a9b-467d-a2b4-b9b349d22e1d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:52.458772 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-432358ae-6a9b-467d-a2b4-b9b349d22e1d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:52.459616 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-432358ae-6a9b-467d-a2b4-b9b349d22e1d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:52.627733 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cce3ab3d-04d4-4c3f-84ac-84d9693660f9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:52.649557 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cce3ab3d-04d4-4c3f-84ac-84d9693660f9 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1556 microversion: 2.1 time: 0.331820 Nov 11 20:42:52.652019 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 545/968] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:52 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1556 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:52.747268 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-432358ae-6a9b-467d-a2b4-b9b349d22e1d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:52.755954 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-432358ae-6a9b-467d-a2b4-b9b349d22e1d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1318 microversion: 2.1 time: 0.313802 Nov 11 20:42:52.756576 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 424/969] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:52 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:53.046646 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e7314629-76fc-4706-a61d-2f503e84dd74 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:53.047255 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e7314629-76fc-4706-a61d-2f503e84dd74 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:53.054896 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e7314629-76fc-4706-a61d-2f503e84dd74 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:53.055326 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e7314629-76fc-4706-a61d-2f503e84dd74 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:53.056143 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e7314629-76fc-4706-a61d-2f503e84dd74 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:53.056570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e7314629-76fc-4706-a61d-2f503e84dd74 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:53.220161 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e7314629-76fc-4706-a61d-2f503e84dd74 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:53.223913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1811ae88-a984-4745-a141-60bb3908647c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:53.233681 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e7314629-76fc-4706-a61d-2f503e84dd74 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.186329 Nov 11 20:42:53.233681 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 546/970] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:53 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:53.234502 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1811ae88-a984-4745-a141-60bb3908647c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:53.240913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1811ae88-a984-4745-a141-60bb3908647c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:53.241487 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1811ae88-a984-4745-a141-60bb3908647c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:53.243194 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1811ae88-a984-4745-a141-60bb3908647c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:53.243639 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1811ae88-a984-4745-a141-60bb3908647c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:53.398768 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-1811ae88-a984-4745-a141-60bb3908647c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:53.410303 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1811ae88-a984-4745-a141-60bb3908647c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.190041 Nov 11 20:42:53.411335 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 425/971] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:53 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:53.667721 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0a9c2b8b-4219-41ac-a527-d68e6da8cf2b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:53.668376 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0a9c2b8b-4219-41ac-a527-d68e6da8cf2b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:53.674146 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0a9c2b8b-4219-41ac-a527-d68e6da8cf2b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:53.674601 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0a9c2b8b-4219-41ac-a527-d68e6da8cf2b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:53.675388 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0a9c2b8b-4219-41ac-a527-d68e6da8cf2b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:53.675904 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0a9c2b8b-4219-41ac-a527-d68e6da8cf2b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:53.774242 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b4b88631-f09c-418a-b830-37423a91378b tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:53.774925 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b4b88631-f09c-418a-b830-37423a91378b tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:53.781268 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b4b88631-f09c-418a-b830-37423a91378b tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:53.781829 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b4b88631-f09c-418a-b830-37423a91378b tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:53.783022 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b4b88631-f09c-418a-b830-37423a91378b tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:53.783669 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b4b88631-f09c-418a-b830-37423a91378b tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:53.816379 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0a9c2b8b-4219-41ac-a527-d68e6da8cf2b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:53.827504 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0a9c2b8b-4219-41ac-a527-d68e6da8cf2b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1556 microversion: 2.1 time: 0.164601 Nov 11 20:42:53.828435 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 547/972] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:53 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:53.928278 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b4b88631-f09c-418a-b830-37423a91378b tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:53.936270 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b4b88631-f09c-418a-b830-37423a91378b tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1318 microversion: 2.1 time: 0.166626 Nov 11 20:42:53.937197 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 426/973] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:53 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:54.247239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e2d6416d-345a-4ba6-a157-785c937140a3 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:54.247849 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e2d6416d-345a-4ba6-a157-785c937140a3 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:54.254894 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e2d6416d-345a-4ba6-a157-785c937140a3 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:54.255460 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e2d6416d-345a-4ba6-a157-785c937140a3 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:54.256468 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e2d6416d-345a-4ba6-a157-785c937140a3 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:54.256908 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e2d6416d-345a-4ba6-a157-785c937140a3 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:54.404024 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e2d6416d-345a-4ba6-a157-785c937140a3 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:54.411648 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e2d6416d-345a-4ba6-a157-785c937140a3 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.168311 Nov 11 20:42:54.412228 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 548/974] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:54 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:54.428728 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b51753c8-c59a-43da-b1e0-91a7ebb23327 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:54.431261 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b51753c8-c59a-43da-b1e0-91a7ebb23327 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:54.438605 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b51753c8-c59a-43da-b1e0-91a7ebb23327 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:54.439122 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b51753c8-c59a-43da-b1e0-91a7ebb23327 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:54.439983 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b51753c8-c59a-43da-b1e0-91a7ebb23327 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:54.440459 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b51753c8-c59a-43da-b1e0-91a7ebb23327 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:54.601000 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b51753c8-c59a-43da-b1e0-91a7ebb23327 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:54.610873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b51753c8-c59a-43da-b1e0-91a7ebb23327 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.185796 Nov 11 20:42:54.611681 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 427/975] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:54 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:54.845485 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8f838409-ac15-42cf-a1d1-64c29aa34995 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:54.846243 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8f838409-ac15-42cf-a1d1-64c29aa34995 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:54.855358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8f838409-ac15-42cf-a1d1-64c29aa34995 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:54.855358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8f838409-ac15-42cf-a1d1-64c29aa34995 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:54.855358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8f838409-ac15-42cf-a1d1-64c29aa34995 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:54.855652 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8f838409-ac15-42cf-a1d1-64c29aa34995 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:54.952930 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-bd8e6729-62ca-4fbf-9feb-992dd868b474 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:54.953533 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-bd8e6729-62ca-4fbf-9feb-992dd868b474 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:54.959902 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bd8e6729-62ca-4fbf-9feb-992dd868b474 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:54.960383 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bd8e6729-62ca-4fbf-9feb-992dd868b474 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:54.961148 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bd8e6729-62ca-4fbf-9feb-992dd868b474 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:54.961756 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bd8e6729-62ca-4fbf-9feb-992dd868b474 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:54.994798 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8f838409-ac15-42cf-a1d1-64c29aa34995 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:55.012127 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8f838409-ac15-42cf-a1d1-64c29aa34995 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1556 microversion: 2.1 time: 0.170427 Nov 11 20:42:55.021647 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 549/976] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:54 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:55.102733 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-bd8e6729-62ca-4fbf-9feb-992dd868b474 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:55.110536 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-bd8e6729-62ca-4fbf-9feb-992dd868b474 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1318 microversion: 2.1 time: 0.161128 Nov 11 20:42:55.111037 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 428/977] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:54 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:55.430625 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-35938def-d295-4e6b-a592-552e9693b91d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:55.431239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-35938def-d295-4e6b-a592-552e9693b91d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:55.438603 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-35938def-d295-4e6b-a592-552e9693b91d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:55.438603 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-35938def-d295-4e6b-a592-552e9693b91d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:55.438913 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-35938def-d295-4e6b-a592-552e9693b91d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:55.439242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-35938def-d295-4e6b-a592-552e9693b91d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:55.591317 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-35938def-d295-4e6b-a592-552e9693b91d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:55.599920 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-35938def-d295-4e6b-a592-552e9693b91d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.174013 Nov 11 20:42:55.600659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 550/978] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:55 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:55.628897 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-569286e0-9995-46e5-8a8d-9c8b5a36baaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:55.629452 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-569286e0-9995-46e5-8a8d-9c8b5a36baaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:55.635532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-569286e0-9995-46e5-8a8d-9c8b5a36baaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:55.636265 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-569286e0-9995-46e5-8a8d-9c8b5a36baaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:55.637064 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-569286e0-9995-46e5-8a8d-9c8b5a36baaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:55.637784 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-569286e0-9995-46e5-8a8d-9c8b5a36baaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:55.782471 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-569286e0-9995-46e5-8a8d-9c8b5a36baaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:55.793280 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-569286e0-9995-46e5-8a8d-9c8b5a36baaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.168539 Nov 11 20:42:55.793941 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 429/979] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:55 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:56.029770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3297ee70-208a-42e4-b7fe-994ce02027ff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:56.030529 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3297ee70-208a-42e4-b7fe-994ce02027ff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:56.036844 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3297ee70-208a-42e4-b7fe-994ce02027ff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:56.037343 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3297ee70-208a-42e4-b7fe-994ce02027ff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:56.038089 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3297ee70-208a-42e4-b7fe-994ce02027ff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:56.039483 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3297ee70-208a-42e4-b7fe-994ce02027ff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:56.129552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9e9c5dfb-e3a4-4c5d-b0c8-a0e95f2bdecc tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:56.130410 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9e9c5dfb-e3a4-4c5d-b0c8-a0e95f2bdecc tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:56.138540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9e9c5dfb-e3a4-4c5d-b0c8-a0e95f2bdecc tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:56.138906 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9e9c5dfb-e3a4-4c5d-b0c8-a0e95f2bdecc tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:56.140206 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9e9c5dfb-e3a4-4c5d-b0c8-a0e95f2bdecc tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:56.140651 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9e9c5dfb-e3a4-4c5d-b0c8-a0e95f2bdecc tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:56.519653 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3297ee70-208a-42e4-b7fe-994ce02027ff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:56.532700 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3297ee70-208a-42e4-b7fe-994ce02027ff tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1556 microversion: 2.1 time: 0.506482 Nov 11 20:42:56.545065 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 551/980] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:56 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1556 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:56.562822 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9e9c5dfb-e3a4-4c5d-b0c8-a0e95f2bdecc tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:56.570855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9e9c5dfb-e3a4-4c5d-b0c8-a0e95f2bdecc tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1318 microversion: 2.1 time: 0.446252 Nov 11 20:42:56.571425 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 430/981] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:56 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:56.581850 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-352893323", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-897741008", "security_groups": [{"name": "tempest-secgroup-smoke-1070841398"}], "block_device_mapping_v2": [{"uuid": "6511bc89-a466-45bf-8a61-c52ee47ea062", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79971f2e-5dd3-4116-8573-ccbb33e6422f"}]}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:56.619376 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6a511c9d-ed67-40c1-a7ac-7c78ca021d03 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:56.620187 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6a511c9d-ed67-40c1-a7ac-7c78ca021d03 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:56.628621 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6a511c9d-ed67-40c1-a7ac-7c78ca021d03 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:56.629673 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6a511c9d-ed67-40c1-a7ac-7c78ca021d03 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:56.630834 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6a511c9d-ed67-40c1-a7ac-7c78ca021d03 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:56.631521 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6a511c9d-ed67-40c1-a7ac-7c78ca021d03 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:56.756038 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.network.neutron [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] validate_networks() for [('79971f2e-5dd3-4116-8573-ccbb33e6422f', None, None, None, None, None)] {{(pid=122526) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:42:56.928912 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-6a511c9d-ed67-40c1-a7ac-7c78ca021d03 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:56.937326 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6a511c9d-ed67-40c1-a7ac-7c78ca021d03 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.323524 Nov 11 20:42:56.938219 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 431/982] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:56 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:56.943628 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-57d09750-1f06-4b6a-81a3-53545224c3bc req-265c38d0-40dc-4e46-8ead-683dbfd4df1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e8e904-4a99-4f15-bb67-de6de15ca227", "name": "network-vif-plugged", "status": "completed", "tag": "264d6612-f400-47b2-8c4e-bdd88f54e280"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:42:56.946645 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:42:56.946645 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:42:56.954874 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-57d09750-1f06-4b6a-81a3-53545224c3bc req-265c38d0-40dc-4e46-8ead-683dbfd4df1d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:56.955493 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-57d09750-1f06-4b6a-81a3-53545224c3bc req-265c38d0-40dc-4e46-8ead-683dbfd4df1d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:56.968377 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-57d09750-1f06-4b6a-81a3-53545224c3bc req-265c38d0-40dc-4e46-8ead-683dbfd4df1d service nova] Creating event network-vif-plugged:264d6612-f400-47b2-8c4e-bdd88f54e280 for instance f8e8e904-4a99-4f15-bb67-de6de15ca227 on hv-cinder-81764 Nov 11 20:42:56.973218 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-57d09750-1f06-4b6a-81a3-53545224c3bc req-265c38d0-40dc-4e46-8ead-683dbfd4df1d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033637 Nov 11 20:42:56.974009 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 432/983] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:42:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:56.980659 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f86208e0-a522-4c2c-8407-a0e775c9148d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:56.981373 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f86208e0-a522-4c2c-8407-a0e775c9148d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:56.987654 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f86208e0-a522-4c2c-8407-a0e775c9148d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:56.988113 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f86208e0-a522-4c2c-8407-a0e775c9148d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:56.988891 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f86208e0-a522-4c2c-8407-a0e775c9148d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:56.989317 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f86208e0-a522-4c2c-8407-a0e775c9148d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:57.284719 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f86208e0-a522-4c2c-8407-a0e775c9148d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:57.293687 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f86208e0-a522-4c2c-8407-a0e775c9148d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.318378 Nov 11 20:42:57.294468 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 433/984] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:56 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:57.336811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Flavor limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:42:57.337646 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Image limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:42:57.338174 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Flavor pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:42:57.338638 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Image pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:42:57.339253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:42:57.350213 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:57.350658 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:57.352137 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:57.352572 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:57.369313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Getting quotas for project 4dd611087eb441dc94ef8c18b6b7d600. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:42:57.373173 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Getting quotas for user 32c40f3d5b074a22b2c48caef9230615 and project 4dd611087eb441dc94ef8c18b6b7d600. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:42:57.428901 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Going to run 1 instances... {{(pid=122526) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:42:57.431836 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6511bc89-a466-45bf-8a61-c52ee47ea062',volume_size=None,volume_type=None)] {{(pid=122526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:42:57.550875 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-941740ee-952f-4299-9982-efc1319674c1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:57.551591 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-941740ee-952f-4299-9982-efc1319674c1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:57.557667 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-941740ee-952f-4299-9982-efc1319674c1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:57.558128 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-941740ee-952f-4299-9982-efc1319674c1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:57.562372 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-941740ee-952f-4299-9982-efc1319674c1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:57.562372 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-941740ee-952f-4299-9982-efc1319674c1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:57.562557 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-34fced99-7568-491a-9c1f-d4039a8652fb tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.988650 Nov 11 20:42:57.567276 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 552/985] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:42:56 2021] POST /compute/v2.1/servers => generated 406 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:42:57.572370 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9b481e28-5c7a-45ab-bb1f-635659953ac6 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:57.572984 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9b481e28-5c7a-45ab-bb1f-635659953ac6 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:57.636701 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9b481e28-5c7a-45ab-bb1f-635659953ac6 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:57.644214 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9b481e28-5c7a-45ab-bb1f-635659953ac6 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1093 microversion: 2.1 time: 0.075685 Nov 11 20:42:57.644765 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 553/986] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:57 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:57.650171 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7f4395fe-f399-4044-8a8d-a033212ff1ee tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:57.650786 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7f4395fe-f399-4044-8a8d-a033212ff1ee tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:57.660095 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7f4395fe-f399-4044-8a8d-a033212ff1ee tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:57.660804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7f4395fe-f399-4044-8a8d-a033212ff1ee tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:57.661601 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7f4395fe-f399-4044-8a8d-a033212ff1ee tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:57.661993 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7f4395fe-f399-4044-8a8d-a033212ff1ee tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:57.787353 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-941740ee-952f-4299-9982-efc1319674c1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:57.797446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-941740ee-952f-4299-9982-efc1319674c1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1562 microversion: 2.1 time: 0.250382 Nov 11 20:42:57.798663 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 434/987] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:57 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1562 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:57.862997 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7f4395fe-f399-4044-8a8d-a033212ff1ee tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:57.881377 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7f4395fe-f399-4044-8a8d-a033212ff1ee tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1318 microversion: 2.1 time: 0.235401 Nov 11 20:42:57.882623 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 554/988] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:57 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:57.883193 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a7cd3caf-25fb-44a6-a8e5-612f27152b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:57.883927 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a7cd3caf-25fb-44a6-a8e5-612f27152b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:57.896462 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a7cd3caf-25fb-44a6-a8e5-612f27152b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:57.897140 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a7cd3caf-25fb-44a6-a8e5-612f27152b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:57.899210 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a7cd3caf-25fb-44a6-a8e5-612f27152b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:57.899725 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a7cd3caf-25fb-44a6-a8e5-612f27152b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:57.954458 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-285f167c-bcad-447c-83e2-b68f1288f5a0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:57.955144 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-285f167c-bcad-447c-83e2-b68f1288f5a0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:57.962434 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-285f167c-bcad-447c-83e2-b68f1288f5a0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:57.962994 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-285f167c-bcad-447c-83e2-b68f1288f5a0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:57.963864 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-285f167c-bcad-447c-83e2-b68f1288f5a0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:57.964397 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-285f167c-bcad-447c-83e2-b68f1288f5a0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:58.001873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.objects.instance [None req-a7cd3caf-25fb-44a6-a8e5-612f27152b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lazy-loading 'services' on Instance uuid ddd75246-98f4-4479-be99-f39c6427cc92 {{(pid=122527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:42:58.092548 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a7cd3caf-25fb-44a6-a8e5-612f27152b83 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments/c5be2936-3d74-42c2-9f7d-2d5684aeddc4" status: 202 len: 0 microversion: 2.1 time: 0.214077 Nov 11 20:42:58.093134 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 435/989] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Nov 11 20:42:57 2021] DELETE /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments/c5be2936-3d74-42c2-9f7d-2d5684aeddc4 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:42:58.104622 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-630ba76a-b9c6-4d40-ad64-6af0922d10b1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:58.106132 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-630ba76a-b9c6-4d40-ad64-6af0922d10b1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:58.127721 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-630ba76a-b9c6-4d40-ad64-6af0922d10b1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:58.129827 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-630ba76a-b9c6-4d40-ad64-6af0922d10b1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:58.131280 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-630ba76a-b9c6-4d40-ad64-6af0922d10b1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:58.133795 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-630ba76a-b9c6-4d40-ad64-6af0922d10b1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:58.151468 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-285f167c-bcad-447c-83e2-b68f1288f5a0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:58.161299 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-285f167c-bcad-447c-83e2-b68f1288f5a0 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.210462 Nov 11 20:42:58.172160 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 555/990] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:57 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:58.176906 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-630ba76a-b9c6-4d40-ad64-6af0922d10b1 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077836 Nov 11 20:42:58.180067 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 436/991] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:42:58 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:58.310722 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b0ca6cb9-44ff-41e8-8488-c2647d608958 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:58.311628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b0ca6cb9-44ff-41e8-8488-c2647d608958 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:58.317391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0ca6cb9-44ff-41e8-8488-c2647d608958 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:58.317838 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0ca6cb9-44ff-41e8-8488-c2647d608958 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:58.318692 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0ca6cb9-44ff-41e8-8488-c2647d608958 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:58.319341 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0ca6cb9-44ff-41e8-8488-c2647d608958 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:58.463229 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b0ca6cb9-44ff-41e8-8488-c2647d608958 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:58.470993 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b0ca6cb9-44ff-41e8-8488-c2647d608958 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.163932 Nov 11 20:42:58.471667 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 556/992] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:58 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:58.662151 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-63a736d3-9fc7-465c-9cad-b426e825fb83 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:58.662756 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-63a736d3-9fc7-465c-9cad-b426e825fb83 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:58.668900 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-63a736d3-9fc7-465c-9cad-b426e825fb83 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:58.669341 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-63a736d3-9fc7-465c-9cad-b426e825fb83 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:58.670114 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-63a736d3-9fc7-465c-9cad-b426e825fb83 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:58.670724 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-63a736d3-9fc7-465c-9cad-b426e825fb83 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:58.734460 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-63a736d3-9fc7-465c-9cad-b426e825fb83 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:58.742241 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-63a736d3-9fc7-465c-9cad-b426e825fb83 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1191 microversion: 2.1 time: 0.083959 Nov 11 20:42:58.742827 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 437/993] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:58 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:58.899576 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6041ba10-022c-4815-94ab-ef44f271fd47 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:58.900215 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6041ba10-022c-4815-94ab-ef44f271fd47 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:58.906387 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6041ba10-022c-4815-94ab-ef44f271fd47 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:58.906739 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6041ba10-022c-4815-94ab-ef44f271fd47 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:58.907518 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6041ba10-022c-4815-94ab-ef44f271fd47 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:58.908266 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6041ba10-022c-4815-94ab-ef44f271fd47 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:59.057327 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6041ba10-022c-4815-94ab-ef44f271fd47 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:59.065305 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6041ba10-022c-4815-94ab-ef44f271fd47 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1318 microversion: 2.1 time: 0.170436 Nov 11 20:42:59.066069 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 557/994] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:58 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:59.179568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-66f08d84-988e-44dd-a5a3-4f1031679281 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:59.180979 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-66f08d84-988e-44dd-a5a3-4f1031679281 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:59.190683 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-66f08d84-988e-44dd-a5a3-4f1031679281 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:59.191763 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-66f08d84-988e-44dd-a5a3-4f1031679281 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:59.192771 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-66f08d84-988e-44dd-a5a3-4f1031679281 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:59.193197 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-66f08d84-988e-44dd-a5a3-4f1031679281 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:59.196569 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7b480963-dce7-4681-8856-f7ffc6bd32c3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:59.197683 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7b480963-dce7-4681-8856-f7ffc6bd32c3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:59.203994 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7b480963-dce7-4681-8856-f7ffc6bd32c3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:59.204601 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7b480963-dce7-4681-8856-f7ffc6bd32c3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:59.205625 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7b480963-dce7-4681-8856-f7ffc6bd32c3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:59.206262 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7b480963-dce7-4681-8856-f7ffc6bd32c3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:59.247216 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7b480963-dce7-4681-8856-f7ffc6bd32c3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061401 Nov 11 20:42:59.248731 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 558/995] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:42:59 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:42:59.469889 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-66f08d84-988e-44dd-a5a3-4f1031679281 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:59.487804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e8570ea0-2314-45ee-900e-d4728c4f0422 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:59.488444 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e8570ea0-2314-45ee-900e-d4728c4f0422 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:59.489552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-66f08d84-988e-44dd-a5a3-4f1031679281 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1757 microversion: 2.1 time: 0.314811 Nov 11 20:42:59.490067 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 438/996] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:59 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1757 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:42:59.506143 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8570ea0-2314-45ee-900e-d4728c4f0422 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:59.506586 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8570ea0-2314-45ee-900e-d4728c4f0422 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:59.507433 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8570ea0-2314-45ee-900e-d4728c4f0422 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:59.507912 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e8570ea0-2314-45ee-900e-d4728c4f0422 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:59.727713 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e8570ea0-2314-45ee-900e-d4728c4f0422 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:59.736699 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e8570ea0-2314-45ee-900e-d4728c4f0422 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.252393 Nov 11 20:42:59.737636 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 559/997] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:59 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:42:59.760416 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2e44a329-d8d7-4c95-94bc-7f1760fc6698 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:42:59.761027 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2e44a329-d8d7-4c95-94bc-7f1760fc6698 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:42:59.767131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e44a329-d8d7-4c95-94bc-7f1760fc6698 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:59.768196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e44a329-d8d7-4c95-94bc-7f1760fc6698 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:59.769044 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e44a329-d8d7-4c95-94bc-7f1760fc6698 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:42:59.769480 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2e44a329-d8d7-4c95-94bc-7f1760fc6698 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:42:59.843165 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-2e44a329-d8d7-4c95-94bc-7f1760fc6698 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:42:59.853071 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2e44a329-d8d7-4c95-94bc-7f1760fc6698 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1209 microversion: 2.1 time: 0.098228 Nov 11 20:42:59.863687 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 439/998] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:42:59 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:00.083836 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-65a2d5eb-961c-4ab3-acd4-e2e230e8716a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:00.086596 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-65a2d5eb-961c-4ab3-acd4-e2e230e8716a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:00.100336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-65a2d5eb-961c-4ab3-acd4-e2e230e8716a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:00.101640 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-65a2d5eb-961c-4ab3-acd4-e2e230e8716a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:00.102638 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-65a2d5eb-961c-4ab3-acd4-e2e230e8716a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:00.103242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-65a2d5eb-961c-4ab3-acd4-e2e230e8716a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:00.260072 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ab8f6ea1-df56-43bd-bd92-730a80b67446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:00.260831 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ab8f6ea1-df56-43bd-bd92-730a80b67446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:00.267346 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ab8f6ea1-df56-43bd-bd92-730a80b67446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:00.268087 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ab8f6ea1-df56-43bd-bd92-730a80b67446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:00.269131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ab8f6ea1-df56-43bd-bd92-730a80b67446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:00.269569 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ab8f6ea1-df56-43bd-bd92-730a80b67446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:00.305892 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ab8f6ea1-df56-43bd-bd92-730a80b67446 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050741 Nov 11 20:43:00.306741 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 440/999] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:43:00 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:43:00.335878 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-65a2d5eb-961c-4ab3-acd4-e2e230e8716a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:00.343457 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-65a2d5eb-961c-4ab3-acd4-e2e230e8716a tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1508 microversion: 2.1 time: 0.264517 Nov 11 20:43:00.344972 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 560/1000] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:00 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:00.374688 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1352e7fb-3140-4fe8-904a-c551d05eb633 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9c90a42-775a-4b9a-8440-73ad137a75ca", "device": "/dev/sdb"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:43:00.386099 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1352e7fb-3140-4fe8-904a-c551d05eb633 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:00.420553 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1352e7fb-3140-4fe8-904a-c551d05eb633 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:00.421016 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1352e7fb-3140-4fe8-904a-c551d05eb633 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:00.421836 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1352e7fb-3140-4fe8-904a-c551d05eb633 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:00.422269 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1352e7fb-3140-4fe8-904a-c551d05eb633 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:00.509764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ba24965a-8c90-4d95-a25a-7e7123bda478 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:00.510432 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ba24965a-8c90-4d95-a25a-7e7123bda478 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:00.522421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ba24965a-8c90-4d95-a25a-7e7123bda478 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:00.522421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ba24965a-8c90-4d95-a25a-7e7123bda478 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:00.522421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ba24965a-8c90-4d95-a25a-7e7123bda478 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:00.522421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ba24965a-8c90-4d95-a25a-7e7123bda478 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:00.831313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ba24965a-8c90-4d95-a25a-7e7123bda478 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:00.841110 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ba24965a-8c90-4d95-a25a-7e7123bda478 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1760 microversion: 2.1 time: 0.338200 Nov 11 20:43:00.841711 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 561/1001] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:00 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1760 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:00.851448 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1957e4cd-d03a-47b5-8fa2-6a78cb5a37a0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:00.852418 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1957e4cd-d03a-47b5-8fa2-6a78cb5a37a0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:00.859480 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1352e7fb-3140-4fe8-904a-c551d05eb633 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "POST /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489387 Nov 11 20:43:00.860413 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 441/1002] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:43:00 2021] POST /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:43:00.870291 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1957e4cd-d03a-47b5-8fa2-6a78cb5a37a0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:00.870966 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1957e4cd-d03a-47b5-8fa2-6a78cb5a37a0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:00.871935 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1957e4cd-d03a-47b5-8fa2-6a78cb5a37a0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:00.872557 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1957e4cd-d03a-47b5-8fa2-6a78cb5a37a0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:00.902715 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e445d833-d1d3-4455-bb03-ca5b920071d1 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:00.905246 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e445d833-d1d3-4455-bb03-ca5b920071d1 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:00.926889 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e445d833-d1d3-4455-bb03-ca5b920071d1 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:00.928324 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e445d833-d1d3-4455-bb03-ca5b920071d1 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:00.931008 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e445d833-d1d3-4455-bb03-ca5b920071d1 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:00.932925 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e445d833-d1d3-4455-bb03-ca5b920071d1 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:01.195196 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1957e4cd-d03a-47b5-8fa2-6a78cb5a37a0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:01.203046 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1957e4cd-d03a-47b5-8fa2-6a78cb5a37a0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.360327 Nov 11 20:43:01.205213 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 562/1003] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:00 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:01.268709 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e445d833-d1d3-4455-bb03-ca5b920071d1 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:01.277089 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e445d833-d1d3-4455-bb03-ca5b920071d1 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.396235 Nov 11 20:43:01.277686 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 442/1004] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:00 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:01.357134 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-cdab4319-468a-47a3-bd06-4146efbbbfa9 req-5c8aeb46-549a-4345-ae44-8f4c818e1aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6650f0-499e-492c-bb9f-6424e765a81b", "tag": "6f3857bd-08bc-4ee4-a39a-331ef661cbbd"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:43:01.358773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:43:01.358773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:43:01.370050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-cdab4319-468a-47a3-bd06-4146efbbbfa9 req-5c8aeb46-549a-4345-ae44-8f4c818e1aa5 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:01.370677 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-cdab4319-468a-47a3-bd06-4146efbbbfa9 req-5c8aeb46-549a-4345-ae44-8f4c818e1aa5 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:01.386905 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-cdab4319-468a-47a3-bd06-4146efbbbfa9 req-5c8aeb46-549a-4345-ae44-8f4c818e1aa5 service nova] Creating event network-changed:6f3857bd-08bc-4ee4-a39a-331ef661cbbd for instance 1a6650f0-499e-492c-bb9f-6424e765a81b on hv-cinder-81764 Nov 11 20:43:01.391951 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-cdab4319-468a-47a3-bd06-4146efbbbfa9 req-5c8aeb46-549a-4345-ae44-8f4c818e1aa5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038491 Nov 11 20:43:01.392591 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 563/1005] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:43:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:43:02.222360 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7da5f288-1a17-47ae-be7d-ca3087c42d17 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:02.222983 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7da5f288-1a17-47ae-be7d-ca3087c42d17 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:02.230523 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7da5f288-1a17-47ae-be7d-ca3087c42d17 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:02.230975 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7da5f288-1a17-47ae-be7d-ca3087c42d17 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:02.231764 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7da5f288-1a17-47ae-be7d-ca3087c42d17 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:02.232248 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7da5f288-1a17-47ae-be7d-ca3087c42d17 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:02.300659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ca6b8bff-615e-40c1-9e67-fa09a0a9b538 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:02.301799 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ca6b8bff-615e-40c1-9e67-fa09a0a9b538 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:02.308717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca6b8bff-615e-40c1-9e67-fa09a0a9b538 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:02.309273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca6b8bff-615e-40c1-9e67-fa09a0a9b538 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:02.310113 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca6b8bff-615e-40c1-9e67-fa09a0a9b538 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:02.310610 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ca6b8bff-615e-40c1-9e67-fa09a0a9b538 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:02.496685 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7da5f288-1a17-47ae-be7d-ca3087c42d17 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:02.504869 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7da5f288-1a17-47ae-be7d-ca3087c42d17 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.286420 Nov 11 20:43:02.505453 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 443/1006] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:02 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:02.582274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ca6b8bff-615e-40c1-9e67-fa09a0a9b538 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:02.590229 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ca6b8bff-615e-40c1-9e67-fa09a0a9b538 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.294046 Nov 11 20:43:02.590795 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 564/1007] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:02 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:02.681646 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d02f51c1-fcdd-4d82-9dec-6345add9ffbb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:02.682147 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d02f51c1-fcdd-4d82-9dec-6345add9ffbb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:02.688196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d02f51c1-fcdd-4d82-9dec-6345add9ffbb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:02.688654 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d02f51c1-fcdd-4d82-9dec-6345add9ffbb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:02.689527 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d02f51c1-fcdd-4d82-9dec-6345add9ffbb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:02.689967 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d02f51c1-fcdd-4d82-9dec-6345add9ffbb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:02.715196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d02f51c1-fcdd-4d82-9dec-6345add9ffbb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Going to try to terminate instance {{(pid=122527) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:43:02.791845 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d02f51c1-fcdd-4d82-9dec-6345add9ffbb tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 204 len: 0 microversion: 2.1 time: 0.113680 Nov 11 20:43:02.792410 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 444/1008] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:43:02 2021] DELETE /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:43:02.800852 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3179a664-2bd5-4b56-a374-ca335581b2ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:02.801468 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3179a664-2bd5-4b56-a374-ca335581b2ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:02.807351 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3179a664-2bd5-4b56-a374-ca335581b2ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:02.807792 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3179a664-2bd5-4b56-a374-ca335581b2ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:02.808602 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3179a664-2bd5-4b56-a374-ca335581b2ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:02.809037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3179a664-2bd5-4b56-a374-ca335581b2ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:02.948616 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3179a664-2bd5-4b56-a374-ca335581b2ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:02.955780 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3179a664-2bd5-4b56-a374-ca335581b2ce tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1508 microversion: 2.1 time: 0.159003 Nov 11 20:43:02.956379 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 565/1009] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:02 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:03.522753 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-61fa1dea-924d-4954-9a45-c1b925ebedb7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:03.523456 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-61fa1dea-924d-4954-9a45-c1b925ebedb7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:03.529669 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-61fa1dea-924d-4954-9a45-c1b925ebedb7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:03.530108 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-61fa1dea-924d-4954-9a45-c1b925ebedb7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:03.530879 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-61fa1dea-924d-4954-9a45-c1b925ebedb7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:03.531307 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-61fa1dea-924d-4954-9a45-c1b925ebedb7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:03.606539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-548a16b1-ce81-44ba-8121-2eeaf3daa4a8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:03.607120 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-548a16b1-ce81-44ba-8121-2eeaf3daa4a8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:03.613373 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-548a16b1-ce81-44ba-8121-2eeaf3daa4a8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:03.613819 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-548a16b1-ce81-44ba-8121-2eeaf3daa4a8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:03.614579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-548a16b1-ce81-44ba-8121-2eeaf3daa4a8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:03.615003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-548a16b1-ce81-44ba-8121-2eeaf3daa4a8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:03.670644 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-61fa1dea-924d-4954-9a45-c1b925ebedb7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:03.681048 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-61fa1dea-924d-4954-9a45-c1b925ebedb7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.161376 Nov 11 20:43:03.681898 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 445/1010] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:03 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:03.757319 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-548a16b1-ce81-44ba-8121-2eeaf3daa4a8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:03.764679 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-548a16b1-ce81-44ba-8121-2eeaf3daa4a8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.161792 Nov 11 20:43:03.765334 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 566/1011] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:03 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:03.973039 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-694328c2-865a-4b1b-a29f-4a870ba44afa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:03.973558 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-694328c2-865a-4b1b-a29f-4a870ba44afa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:03.979836 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-694328c2-865a-4b1b-a29f-4a870ba44afa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:03.980301 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-694328c2-865a-4b1b-a29f-4a870ba44afa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:03.981073 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-694328c2-865a-4b1b-a29f-4a870ba44afa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:03.981502 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-694328c2-865a-4b1b-a29f-4a870ba44afa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:04.127250 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-694328c2-865a-4b1b-a29f-4a870ba44afa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:04.134556 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-694328c2-865a-4b1b-a29f-4a870ba44afa tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1508 microversion: 2.1 time: 0.165221 Nov 11 20:43:04.135108 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 446/1012] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:03 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:04.699059 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5f5f863b-7dc0-4b2a-b1d1-24842bce0da7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:04.699637 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5f5f863b-7dc0-4b2a-b1d1-24842bce0da7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:04.705978 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5f5f863b-7dc0-4b2a-b1d1-24842bce0da7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:04.706420 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5f5f863b-7dc0-4b2a-b1d1-24842bce0da7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:04.707186 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5f5f863b-7dc0-4b2a-b1d1-24842bce0da7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:04.707875 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5f5f863b-7dc0-4b2a-b1d1-24842bce0da7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:04.781587 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5f8a9ac1-e4d1-493e-9b15-ad0215531f68 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:04.782220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5f8a9ac1-e4d1-493e-9b15-ad0215531f68 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:04.788702 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5f8a9ac1-e4d1-493e-9b15-ad0215531f68 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:04.789547 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5f8a9ac1-e4d1-493e-9b15-ad0215531f68 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:04.790167 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5f8a9ac1-e4d1-493e-9b15-ad0215531f68 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:04.790735 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5f8a9ac1-e4d1-493e-9b15-ad0215531f68 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:04.866180 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5f5f863b-7dc0-4b2a-b1d1-24842bce0da7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:04.875197 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5f5f863b-7dc0-4b2a-b1d1-24842bce0da7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.180530 Nov 11 20:43:04.875772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 567/1013] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:04 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:04.939956 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5f8a9ac1-e4d1-493e-9b15-ad0215531f68 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:04.948036 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5f8a9ac1-e4d1-493e-9b15-ad0215531f68 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.170055 Nov 11 20:43:04.948629 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 447/1014] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:04 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:05.150416 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-097fea0b-7e3c-4618-a22b-418d8df953d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:05.151023 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-097fea0b-7e3c-4618-a22b-418d8df953d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:05.156838 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-097fea0b-7e3c-4618-a22b-418d8df953d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:05.157292 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-097fea0b-7e3c-4618-a22b-418d8df953d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:05.158071 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-097fea0b-7e3c-4618-a22b-418d8df953d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:05.158507 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-097fea0b-7e3c-4618-a22b-418d8df953d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:05.288112 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-097fea0b-7e3c-4618-a22b-418d8df953d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:05.295831 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-097fea0b-7e3c-4618-a22b-418d8df953d7 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1508 microversion: 2.1 time: 0.149257 Nov 11 20:43:05.296416 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 568/1015] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:05 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:05.893231 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d1a324d4-723f-42cc-9d04-e2f6d3a72dbe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:05.893829 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d1a324d4-723f-42cc-9d04-e2f6d3a72dbe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:05.900959 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d1a324d4-723f-42cc-9d04-e2f6d3a72dbe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:05.901424 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d1a324d4-723f-42cc-9d04-e2f6d3a72dbe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:05.902259 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d1a324d4-723f-42cc-9d04-e2f6d3a72dbe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:05.902701 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d1a324d4-723f-42cc-9d04-e2f6d3a72dbe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:05.965803 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-82abb1dc-e968-41d1-812b-ffe72ea760aa tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:05.966928 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-82abb1dc-e968-41d1-812b-ffe72ea760aa tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:05.974901 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-82abb1dc-e968-41d1-812b-ffe72ea760aa tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:05.975271 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-82abb1dc-e968-41d1-812b-ffe72ea760aa tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:05.976898 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-82abb1dc-e968-41d1-812b-ffe72ea760aa tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:05.976898 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-82abb1dc-e968-41d1-812b-ffe72ea760aa tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:06.068973 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d1a324d4-723f-42cc-9d04-e2f6d3a72dbe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:06.079779 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d1a324d4-723f-42cc-9d04-e2f6d3a72dbe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.190155 Nov 11 20:43:06.088301 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 448/1016] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:05 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:06.137582 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-82abb1dc-e968-41d1-812b-ffe72ea760aa tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:06.144842 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-82abb1dc-e968-41d1-812b-ffe72ea760aa tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.183687 Nov 11 20:43:06.145401 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 569/1017] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:05 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:06.313618 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-08bfe27e-90cb-4856-9e9d-c587c822ab02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:06.314169 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-08bfe27e-90cb-4856-9e9d-c587c822ab02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:06.320100 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-08bfe27e-90cb-4856-9e9d-c587c822ab02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:06.320549 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-08bfe27e-90cb-4856-9e9d-c587c822ab02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:06.321321 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-08bfe27e-90cb-4856-9e9d-c587c822ab02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:06.322896 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-08bfe27e-90cb-4856-9e9d-c587c822ab02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:06.459658 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-08bfe27e-90cb-4856-9e9d-c587c822ab02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:06.467479 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-08bfe27e-90cb-4856-9e9d-c587c822ab02 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1508 microversion: 2.1 time: 0.157684 Nov 11 20:43:06.468096 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 449/1018] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:06 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:07.097908 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-02368b60-8496-435c-b3cf-4e7636cb8883 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:07.098517 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-02368b60-8496-435c-b3cf-4e7636cb8883 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:07.105618 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-02368b60-8496-435c-b3cf-4e7636cb8883 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:07.106066 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-02368b60-8496-435c-b3cf-4e7636cb8883 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:07.106911 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-02368b60-8496-435c-b3cf-4e7636cb8883 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:07.107496 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-02368b60-8496-435c-b3cf-4e7636cb8883 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:07.161692 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a7fdbef8-27b5-4331-9f0c-5f8eadf840d2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:07.162299 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a7fdbef8-27b5-4331-9f0c-5f8eadf840d2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:07.169212 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a7fdbef8-27b5-4331-9f0c-5f8eadf840d2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:07.169658 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a7fdbef8-27b5-4331-9f0c-5f8eadf840d2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:07.170439 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a7fdbef8-27b5-4331-9f0c-5f8eadf840d2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:07.170870 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a7fdbef8-27b5-4331-9f0c-5f8eadf840d2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:07.270770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-02368b60-8496-435c-b3cf-4e7636cb8883 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:07.280323 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-02368b60-8496-435c-b3cf-4e7636cb8883 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.185988 Nov 11 20:43:07.280906 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 570/1019] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:07 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:07.334857 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a7fdbef8-27b5-4331-9f0c-5f8eadf840d2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:07.343648 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a7fdbef8-27b5-4331-9f0c-5f8eadf840d2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.185595 Nov 11 20:43:07.344267 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 450/1020] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:07 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:07.484904 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cdc72663-2aa7-4865-9aaf-a644ec76880c tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:07.485519 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cdc72663-2aa7-4865-9aaf-a644ec76880c tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:07.491394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cdc72663-2aa7-4865-9aaf-a644ec76880c tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:07.491853 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cdc72663-2aa7-4865-9aaf-a644ec76880c tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:07.492657 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cdc72663-2aa7-4865-9aaf-a644ec76880c tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:07.493099 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cdc72663-2aa7-4865-9aaf-a644ec76880c tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:07.626947 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cdc72663-2aa7-4865-9aaf-a644ec76880c tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:07.638038 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cdc72663-2aa7-4865-9aaf-a644ec76880c tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1508 microversion: 2.1 time: 0.156792 Nov 11 20:43:07.646598 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 571/1021] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:07 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:08.298589 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1702170f-334b-408f-82c0-4321a7fa4175 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:08.299811 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1702170f-334b-408f-82c0-4321a7fa4175 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:08.307727 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1702170f-334b-408f-82c0-4321a7fa4175 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:08.308858 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1702170f-334b-408f-82c0-4321a7fa4175 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:08.310297 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1702170f-334b-408f-82c0-4321a7fa4175 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:08.317861 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1702170f-334b-408f-82c0-4321a7fa4175 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:08.361228 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1dd1de4f-2219-4e09-82b0-525d0eb866da tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:08.363079 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1dd1de4f-2219-4e09-82b0-525d0eb866da tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:08.370468 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1dd1de4f-2219-4e09-82b0-525d0eb866da tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:08.370988 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1dd1de4f-2219-4e09-82b0-525d0eb866da tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:08.374057 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1dd1de4f-2219-4e09-82b0-525d0eb866da tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:08.375277 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1dd1de4f-2219-4e09-82b0-525d0eb866da tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:08.534290 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-1702170f-334b-408f-82c0-4321a7fa4175 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:08.550459 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1702170f-334b-408f-82c0-4321a7fa4175 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.254960 Nov 11 20:43:08.562972 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 451/1022] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:08 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:08.567954 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-cd3d541d-a3ff-49ac-97e8-9a4ca9b72ebe req-e161c0fd-d0b5-43f3-8da5-958cf45c30ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e9bc60a-d6ec-4b5a-a39f-5430afa0b859", "name": "network-vif-deleted", "tag": "767cb3d9-cf56-4615-8623-4ec857595582"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:43:08.569569 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:43:08.569569 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:43:08.578078 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-cd3d541d-a3ff-49ac-97e8-9a4ca9b72ebe req-e161c0fd-d0b5-43f3-8da5-958cf45c30ef service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:08.578552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-cd3d541d-a3ff-49ac-97e8-9a4ca9b72ebe req-e161c0fd-d0b5-43f3-8da5-958cf45c30ef service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:08.590228 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-cd3d541d-a3ff-49ac-97e8-9a4ca9b72ebe req-e161c0fd-d0b5-43f3-8da5-958cf45c30ef service nova] Creating event network-vif-deleted:767cb3d9-cf56-4615-8623-4ec857595582 for instance 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 on hv-cinder-81764 Nov 11 20:43:08.591637 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1dd1de4f-2219-4e09-82b0-525d0eb866da tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:08.595013 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-cd3d541d-a3ff-49ac-97e8-9a4ca9b72ebe req-e161c0fd-d0b5-43f3-8da5-958cf45c30ef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030764 Nov 11 20:43:08.595607 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 452/1023] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:43:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:43:08.599359 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1dd1de4f-2219-4e09-82b0-525d0eb866da tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.242732 Nov 11 20:43:08.599917 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 572/1024] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:08 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:08.655305 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-431e2b55-240b-4711-9c60-99f764209f35 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:08.656079 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-431e2b55-240b-4711-9c60-99f764209f35 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:08.662351 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-431e2b55-240b-4711-9c60-99f764209f35 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:08.662807 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-431e2b55-240b-4711-9c60-99f764209f35 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:08.663599 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-431e2b55-240b-4711-9c60-99f764209f35 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:08.664068 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-431e2b55-240b-4711-9c60-99f764209f35 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:08.699219 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-431e2b55-240b-4711-9c60-99f764209f35 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:08.699576 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-431e2b55-240b-4711-9c60-99f764209f35 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:08.700072 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.objects.instance [None req-431e2b55-240b-4711-9c60-99f764209f35 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lazy-loading 'fault' on Instance uuid 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 {{(pid=122527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:43:08.741880 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-431e2b55-240b-4711-9c60-99f764209f35 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:08.749651 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-431e2b55-240b-4711-9c60-99f764209f35 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 200 len: 1311 microversion: 2.1 time: 0.098568 Nov 11 20:43:08.750254 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 453/1025] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:08 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:09.569174 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b557b06f-e2ce-4a01-a59d-e16d1d738729 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:09.569784 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b557b06f-e2ce-4a01-a59d-e16d1d738729 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:09.576413 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b557b06f-e2ce-4a01-a59d-e16d1d738729 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:09.576859 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b557b06f-e2ce-4a01-a59d-e16d1d738729 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:09.577645 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b557b06f-e2ce-4a01-a59d-e16d1d738729 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:09.578057 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b557b06f-e2ce-4a01-a59d-e16d1d738729 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:09.615940 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-180abb22-1a2d-4262-9cd5-686af1aa8248 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:09.617186 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-180abb22-1a2d-4262-9cd5-686af1aa8248 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:09.632062 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-180abb22-1a2d-4262-9cd5-686af1aa8248 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:09.632583 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-180abb22-1a2d-4262-9cd5-686af1aa8248 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:09.633436 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-180abb22-1a2d-4262-9cd5-686af1aa8248 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:09.633936 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-180abb22-1a2d-4262-9cd5-686af1aa8248 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:09.761987 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b557b06f-e2ce-4a01-a59d-e16d1d738729 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:09.770568 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b557b06f-e2ce-4a01-a59d-e16d1d738729 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.205282 Nov 11 20:43:09.770918 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 573/1026] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:09 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:09.776619 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8cd0fc2c-1c89-4adf-be27-a80a403a1c36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:09.777230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8cd0fc2c-1c89-4adf-be27-a80a403a1c36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:09.783631 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8cd0fc2c-1c89-4adf-be27-a80a403a1c36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:09.784121 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8cd0fc2c-1c89-4adf-be27-a80a403a1c36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:09.784952 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8cd0fc2c-1c89-4adf-be27-a80a403a1c36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:09.785391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8cd0fc2c-1c89-4adf-be27-a80a403a1c36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:09.799280 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-8cd0fc2c-1c89-4adf-be27-a80a403a1c36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] HTTP exception thrown: Instance 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 could not be found. Nov 11 20:43:09.799873 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8cd0fc2c-1c89-4adf-be27-a80a403a1c36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Returning 404 to user: Instance 2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:43:09.800762 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8cd0fc2c-1c89-4adf-be27-a80a403a1c36 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859" status: 404 len: 111 microversion: 2.1 time: 0.028971 Nov 11 20:43:09.801318 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 574/1027] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:09 2021] GET /compute/v2.1/servers/2e9bc60a-d6ec-4b5a-a39f-5430afa0b859 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:43:09.808891 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8fe55d73-49aa-4782-8394-686036b3ba13 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:09.809472 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8fe55d73-49aa-4782-8394-686036b3ba13 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:09.812394 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-180abb22-1a2d-4262-9cd5-686af1aa8248 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:09.815217 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8fe55d73-49aa-4782-8394-686036b3ba13 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:09.815666 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8fe55d73-49aa-4782-8394-686036b3ba13 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:09.816472 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8fe55d73-49aa-4782-8394-686036b3ba13 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:09.816906 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8fe55d73-49aa-4782-8394-686036b3ba13 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:09.819706 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-180abb22-1a2d-4262-9cd5-686af1aa8248 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.207394 Nov 11 20:43:09.820387 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 454/1028] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:09 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:09.843876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8fe55d73-49aa-4782-8394-686036b3ba13 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Going to try to terminate instance {{(pid=122526) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:43:09.917292 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8fe55d73-49aa-4782-8394-686036b3ba13 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 204 len: 0 microversion: 2.1 time: 0.111609 Nov 11 20:43:09.917790 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 575/1029] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:43:09 2021] DELETE /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 11 20:43:09.925686 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d8c241dd-bb5f-44a8-b4f2-bf8e0e05d273 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:09.926378 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d8c241dd-bb5f-44a8-b4f2-bf8e0e05d273 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:09.932800 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d8c241dd-bb5f-44a8-b4f2-bf8e0e05d273 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:09.933251 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d8c241dd-bb5f-44a8-b4f2-bf8e0e05d273 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:09.934043 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d8c241dd-bb5f-44a8-b4f2-bf8e0e05d273 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:09.934490 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d8c241dd-bb5f-44a8-b4f2-bf8e0e05d273 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:10.068188 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d8c241dd-bb5f-44a8-b4f2-bf8e0e05d273 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:10.076221 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d8c241dd-bb5f-44a8-b4f2-bf8e0e05d273 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.154094 Nov 11 20:43:10.076777 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 455/1030] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:09 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:10.789297 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-dd48ab16-e9fe-4d4a-b68b-05a79a22d0d2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:10.789986 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-dd48ab16-e9fe-4d4a-b68b-05a79a22d0d2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:10.796831 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dd48ab16-e9fe-4d4a-b68b-05a79a22d0d2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:10.797270 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dd48ab16-e9fe-4d4a-b68b-05a79a22d0d2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:10.798085 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dd48ab16-e9fe-4d4a-b68b-05a79a22d0d2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:10.798460 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dd48ab16-e9fe-4d4a-b68b-05a79a22d0d2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:10.836797 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5f769abe-9043-44c9-a627-72a9496a98cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:10.838744 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5f769abe-9043-44c9-a627-72a9496a98cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:10.845029 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5f769abe-9043-44c9-a627-72a9496a98cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:10.845478 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5f769abe-9043-44c9-a627-72a9496a98cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:10.846262 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5f769abe-9043-44c9-a627-72a9496a98cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:10.846698 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5f769abe-9043-44c9-a627-72a9496a98cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:10.970657 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-dd48ab16-e9fe-4d4a-b68b-05a79a22d0d2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:10.979225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-dd48ab16-e9fe-4d4a-b68b-05a79a22d0d2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.193961 Nov 11 20:43:10.988979 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 576/1031] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:10 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:11.013451 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5f769abe-9043-44c9-a627-72a9496a98cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:11.020607 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5f769abe-9043-44c9-a627-72a9496a98cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.187671 Nov 11 20:43:11.021179 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 456/1032] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:10 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:11.093810 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6b84d02f-ee3d-411c-9509-87bc4d6ec1e8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:11.094415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6b84d02f-ee3d-411c-9509-87bc4d6ec1e8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:11.100279 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6b84d02f-ee3d-411c-9509-87bc4d6ec1e8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:11.100726 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6b84d02f-ee3d-411c-9509-87bc4d6ec1e8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:11.101495 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6b84d02f-ee3d-411c-9509-87bc4d6ec1e8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:11.101919 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6b84d02f-ee3d-411c-9509-87bc4d6ec1e8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:11.235992 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-6b84d02f-ee3d-411c-9509-87bc4d6ec1e8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:11.243194 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6b84d02f-ee3d-411c-9509-87bc4d6ec1e8 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.152982 Nov 11 20:43:11.244830 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 577/1033] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:11 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:11.996343 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-65cc4285-fb68-40a8-86db-93003fb6dfb6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:11.997022 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-65cc4285-fb68-40a8-86db-93003fb6dfb6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:12.003366 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-65cc4285-fb68-40a8-86db-93003fb6dfb6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:12.003822 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-65cc4285-fb68-40a8-86db-93003fb6dfb6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:12.004637 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-65cc4285-fb68-40a8-86db-93003fb6dfb6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:12.005073 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-65cc4285-fb68-40a8-86db-93003fb6dfb6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:12.038281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-309ae71e-9fd7-45c2-a83a-8ea85250958e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:12.038876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-309ae71e-9fd7-45c2-a83a-8ea85250958e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:12.045256 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-309ae71e-9fd7-45c2-a83a-8ea85250958e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:12.045724 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-309ae71e-9fd7-45c2-a83a-8ea85250958e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:12.046505 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-309ae71e-9fd7-45c2-a83a-8ea85250958e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:12.046934 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-309ae71e-9fd7-45c2-a83a-8ea85250958e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:12.160420 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-65cc4285-fb68-40a8-86db-93003fb6dfb6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:12.168361 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-65cc4285-fb68-40a8-86db-93003fb6dfb6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.175714 Nov 11 20:43:12.168939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 457/1034] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:11 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:12.223027 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-309ae71e-9fd7-45c2-a83a-8ea85250958e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:12.230736 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-309ae71e-9fd7-45c2-a83a-8ea85250958e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.196059 Nov 11 20:43:12.231296 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 578/1035] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:12 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:12.262093 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a8a40555-1ee2-41c4-9f59-8235cbec0eaf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:12.262700 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a8a40555-1ee2-41c4-9f59-8235cbec0eaf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:12.268689 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a8a40555-1ee2-41c4-9f59-8235cbec0eaf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:12.269135 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a8a40555-1ee2-41c4-9f59-8235cbec0eaf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:12.269904 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a8a40555-1ee2-41c4-9f59-8235cbec0eaf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:12.270332 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a8a40555-1ee2-41c4-9f59-8235cbec0eaf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:12.399285 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a8a40555-1ee2-41c4-9f59-8235cbec0eaf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:12.407996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a8a40555-1ee2-41c4-9f59-8235cbec0eaf tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.150223 Nov 11 20:43:12.408564 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 458/1036] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:12 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:13.184707 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bb523d16-ed59-4f50-be12-3736addc512e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:13.185329 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-bb523d16-ed59-4f50-be12-3736addc512e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:13.191457 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bb523d16-ed59-4f50-be12-3736addc512e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:13.191899 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bb523d16-ed59-4f50-be12-3736addc512e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:13.192694 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bb523d16-ed59-4f50-be12-3736addc512e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:13.193123 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bb523d16-ed59-4f50-be12-3736addc512e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:13.247942 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-46b35e15-54dd-4ace-905f-d8aab254a037 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:13.248604 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-46b35e15-54dd-4ace-905f-d8aab254a037 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:13.255031 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-46b35e15-54dd-4ace-905f-d8aab254a037 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:13.255429 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-46b35e15-54dd-4ace-905f-d8aab254a037 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:13.256239 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-46b35e15-54dd-4ace-905f-d8aab254a037 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:13.256679 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-46b35e15-54dd-4ace-905f-d8aab254a037 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:13.352665 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-bb523d16-ed59-4f50-be12-3736addc512e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:13.361250 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bb523d16-ed59-4f50-be12-3736addc512e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.180821 Nov 11 20:43:13.361831 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 579/1037] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:13 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:13.416550 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-46b35e15-54dd-4ace-905f-d8aab254a037 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:13.424015 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-46b35e15-54dd-4ace-905f-d8aab254a037 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.179992 Nov 11 20:43:13.424319 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7ec994b5-86a3-457c-abf2-afde4bf06966 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:13.424806 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 459/1038] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:13 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:13.424924 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7ec994b5-86a3-457c-abf2-afde4bf06966 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:13.431137 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7ec994b5-86a3-457c-abf2-afde4bf06966 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:13.432218 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7ec994b5-86a3-457c-abf2-afde4bf06966 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:13.433110 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7ec994b5-86a3-457c-abf2-afde4bf06966 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:13.433550 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7ec994b5-86a3-457c-abf2-afde4bf06966 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:13.563750 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7ec994b5-86a3-457c-abf2-afde4bf06966 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:13.571254 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7ec994b5-86a3-457c-abf2-afde4bf06966 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.150604 Nov 11 20:43:13.571841 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 580/1039] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:13 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:14.378347 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-355048fa-7f2b-44c6-b37e-92054c626a43 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:14.378955 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-355048fa-7f2b-44c6-b37e-92054c626a43 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:14.385814 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-355048fa-7f2b-44c6-b37e-92054c626a43 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:14.386285 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-355048fa-7f2b-44c6-b37e-92054c626a43 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:14.387081 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-355048fa-7f2b-44c6-b37e-92054c626a43 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:14.387520 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-355048fa-7f2b-44c6-b37e-92054c626a43 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:14.441404 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-474e31b3-30ce-44d7-ad37-3fa708054c72 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:14.442109 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-474e31b3-30ce-44d7-ad37-3fa708054c72 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:14.451395 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-474e31b3-30ce-44d7-ad37-3fa708054c72 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:14.451837 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-474e31b3-30ce-44d7-ad37-3fa708054c72 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:14.452669 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-474e31b3-30ce-44d7-ad37-3fa708054c72 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:14.453239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-474e31b3-30ce-44d7-ad37-3fa708054c72 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:14.560348 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-355048fa-7f2b-44c6-b37e-92054c626a43 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:14.568852 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-355048fa-7f2b-44c6-b37e-92054c626a43 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.194108 Nov 11 20:43:14.569647 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 460/1040] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:14 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:14.588643 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-91a99193-f826-4185-8d1e-5926cc96cdb5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:14.589270 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-91a99193-f826-4185-8d1e-5926cc96cdb5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:14.595158 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-91a99193-f826-4185-8d1e-5926cc96cdb5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:14.595529 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-91a99193-f826-4185-8d1e-5926cc96cdb5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:14.596327 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-91a99193-f826-4185-8d1e-5926cc96cdb5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:14.596756 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-91a99193-f826-4185-8d1e-5926cc96cdb5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:14.628111 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-474e31b3-30ce-44d7-ad37-3fa708054c72 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:14.635910 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-474e31b3-30ce-44d7-ad37-3fa708054c72 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.198093 Nov 11 20:43:14.636505 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 581/1041] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:14 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:14.736659 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-91a99193-f826-4185-8d1e-5926cc96cdb5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:14.746063 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-91a99193-f826-4185-8d1e-5926cc96cdb5 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.160812 Nov 11 20:43:14.746648 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 461/1042] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:14 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:15.586659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f650875c-47ad-44e2-95cb-7f4ba0c34447 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:15.587330 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f650875c-47ad-44e2-95cb-7f4ba0c34447 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:15.594074 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f650875c-47ad-44e2-95cb-7f4ba0c34447 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:15.594515 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f650875c-47ad-44e2-95cb-7f4ba0c34447 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:15.595278 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f650875c-47ad-44e2-95cb-7f4ba0c34447 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:15.595731 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f650875c-47ad-44e2-95cb-7f4ba0c34447 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:15.653368 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6ebb0602-20a8-459d-b45c-202a5ca5f7b5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:15.653952 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6ebb0602-20a8-459d-b45c-202a5ca5f7b5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:15.660205 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6ebb0602-20a8-459d-b45c-202a5ca5f7b5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:15.660658 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6ebb0602-20a8-459d-b45c-202a5ca5f7b5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:15.661432 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6ebb0602-20a8-459d-b45c-202a5ca5f7b5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:15.661859 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6ebb0602-20a8-459d-b45c-202a5ca5f7b5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:15.757231 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f650875c-47ad-44e2-95cb-7f4ba0c34447 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:15.766589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f650875c-47ad-44e2-95cb-7f4ba0c34447 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.183769 Nov 11 20:43:15.767238 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 582/1043] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:15 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:15.771642 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1faada86-2166-4c09-9f13-fe04bb9c5492 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:15.772263 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1faada86-2166-4c09-9f13-fe04bb9c5492 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:15.779355 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1faada86-2166-4c09-9f13-fe04bb9c5492 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:15.779797 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1faada86-2166-4c09-9f13-fe04bb9c5492 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:15.780592 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1faada86-2166-4c09-9f13-fe04bb9c5492 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:15.781017 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1faada86-2166-4c09-9f13-fe04bb9c5492 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:15.835415 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-6ebb0602-20a8-459d-b45c-202a5ca5f7b5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:15.843964 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6ebb0602-20a8-459d-b45c-202a5ca5f7b5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.194871 Nov 11 20:43:15.844765 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 462/1044] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:15 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:15.930624 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1faada86-2166-4c09-9f13-fe04bb9c5492 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:15.939122 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1faada86-2166-4c09-9f13-fe04bb9c5492 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.170906 Nov 11 20:43:15.939708 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 583/1045] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:15 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:16.783854 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8ced8b4d-74f1-41e3-af18-3c79a88e5486 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:16.784503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8ced8b4d-74f1-41e3-af18-3c79a88e5486 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:16.790671 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8ced8b4d-74f1-41e3-af18-3c79a88e5486 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:16.791259 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8ced8b4d-74f1-41e3-af18-3c79a88e5486 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:16.792225 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8ced8b4d-74f1-41e3-af18-3c79a88e5486 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:16.792656 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8ced8b4d-74f1-41e3-af18-3c79a88e5486 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:16.860951 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-19dac561-6096-4108-9ac6-43a52707a68e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:16.861589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-19dac561-6096-4108-9ac6-43a52707a68e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:16.870478 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-19dac561-6096-4108-9ac6-43a52707a68e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:16.870478 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-19dac561-6096-4108-9ac6-43a52707a68e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:16.871113 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-19dac561-6096-4108-9ac6-43a52707a68e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:16.871580 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-19dac561-6096-4108-9ac6-43a52707a68e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:17.128649 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-8ced8b4d-74f1-41e3-af18-3c79a88e5486 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:17.138772 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8ced8b4d-74f1-41e3-af18-3c79a88e5486 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.358521 Nov 11 20:43:17.139469 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 463/1046] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:16 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:17.143910 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b2d47203-8ab1-4904-b70d-dc5efb85dc5b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:17.144532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b2d47203-8ab1-4904-b70d-dc5efb85dc5b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:17.150852 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2d47203-8ab1-4904-b70d-dc5efb85dc5b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:17.151671 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2d47203-8ab1-4904-b70d-dc5efb85dc5b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:17.152585 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2d47203-8ab1-4904-b70d-dc5efb85dc5b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:17.153093 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2d47203-8ab1-4904-b70d-dc5efb85dc5b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:17.178564 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-19dac561-6096-4108-9ac6-43a52707a68e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:17.187015 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-19dac561-6096-4108-9ac6-43a52707a68e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.329779 Nov 11 20:43:17.187637 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 584/1047] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:16 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:17.294945 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b2d47203-8ab1-4904-b70d-dc5efb85dc5b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:17.302492 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b2d47203-8ab1-4904-b70d-dc5efb85dc5b tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.162065 Nov 11 20:43:17.303068 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 464/1048] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:17 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:18.155361 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4cdd6a1c-f71a-4f7c-a65d-f0c4773e3245 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:18.155964 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4cdd6a1c-f71a-4f7c-a65d-f0c4773e3245 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:18.162160 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4cdd6a1c-f71a-4f7c-a65d-f0c4773e3245 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:18.162633 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4cdd6a1c-f71a-4f7c-a65d-f0c4773e3245 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:18.163401 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4cdd6a1c-f71a-4f7c-a65d-f0c4773e3245 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:18.163834 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4cdd6a1c-f71a-4f7c-a65d-f0c4773e3245 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:18.203858 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-027495cb-d41f-4447-9740-ed2085919519 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:18.204506 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-027495cb-d41f-4447-9740-ed2085919519 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:18.210903 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-027495cb-d41f-4447-9740-ed2085919519 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:18.211346 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-027495cb-d41f-4447-9740-ed2085919519 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:18.212168 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-027495cb-d41f-4447-9740-ed2085919519 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:18.212585 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-027495cb-d41f-4447-9740-ed2085919519 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:18.338060 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4cdd6a1c-f71a-4f7c-a65d-f0c4773e3245 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:18.346616 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4cdd6a1c-f71a-4f7c-a65d-f0c4773e3245 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.194976 Nov 11 20:43:18.347187 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 585/1049] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:18 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:18.357029 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0ebe072e-117d-4736-96c5-ff87828f9065 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:18.357029 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0ebe072e-117d-4736-96c5-ff87828f9065 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:18.358649 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ebe072e-117d-4736-96c5-ff87828f9065 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:18.359095 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ebe072e-117d-4736-96c5-ff87828f9065 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:18.359872 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ebe072e-117d-4736-96c5-ff87828f9065 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:18.360323 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ebe072e-117d-4736-96c5-ff87828f9065 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:18.384533 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-027495cb-d41f-4447-9740-ed2085919519 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:18.400494 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-027495cb-d41f-4447-9740-ed2085919519 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.200083 Nov 11 20:43:18.401732 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 465/1050] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:18 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:18.490794 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0ebe072e-117d-4736-96c5-ff87828f9065 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:18.498294 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0ebe072e-117d-4736-96c5-ff87828f9065 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.150025 Nov 11 20:43:18.498791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 586/1051] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:18 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:19.364354 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-885be64c-e1b0-42a4-955c-dc8b83106088 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:19.364949 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-885be64c-e1b0-42a4-955c-dc8b83106088 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:19.375348 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-885be64c-e1b0-42a4-955c-dc8b83106088 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:19.375911 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-885be64c-e1b0-42a4-955c-dc8b83106088 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:19.376749 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-885be64c-e1b0-42a4-955c-dc8b83106088 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:19.377191 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-885be64c-e1b0-42a4-955c-dc8b83106088 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:19.418276 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5723b462-ee52-44b1-8375-0ed295f35a9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:19.418989 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5723b462-ee52-44b1-8375-0ed295f35a9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:19.424997 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5723b462-ee52-44b1-8375-0ed295f35a9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:19.425429 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5723b462-ee52-44b1-8375-0ed295f35a9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:19.426203 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5723b462-ee52-44b1-8375-0ed295f35a9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:19.426628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5723b462-ee52-44b1-8375-0ed295f35a9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:19.549347 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-885be64c-e1b0-42a4-955c-dc8b83106088 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:19.558262 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-885be64c-e1b0-42a4-955c-dc8b83106088 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.197490 Nov 11 20:43:19.559060 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 466/1052] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:19 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:19.570869 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c484f3f0-e1eb-4fcc-bed1-da60dc6bc26d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:19.571475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c484f3f0-e1eb-4fcc-bed1-da60dc6bc26d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:19.577508 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c484f3f0-e1eb-4fcc-bed1-da60dc6bc26d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:19.577966 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c484f3f0-e1eb-4fcc-bed1-da60dc6bc26d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:19.578761 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c484f3f0-e1eb-4fcc-bed1-da60dc6bc26d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:19.579200 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c484f3f0-e1eb-4fcc-bed1-da60dc6bc26d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:19.612635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5723b462-ee52-44b1-8375-0ed295f35a9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:19.620628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5723b462-ee52-44b1-8375-0ed295f35a9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.206038 Nov 11 20:43:19.621281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 587/1053] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:19 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:19.772828 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c484f3f0-e1eb-4fcc-bed1-da60dc6bc26d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:19.782167 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c484f3f0-e1eb-4fcc-bed1-da60dc6bc26d tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.214818 Nov 11 20:43:19.782167 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 467/1054] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:19 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:19.868268 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-e202cd1b-bbe9-473b-b296-b82503766fcc req-5ccf8572-07f8-4382-9099-5dc3c24ab62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6650f0-499e-492c-bb9f-6424e765a81b", "name": "network-vif-plugged", "status": "completed", "tag": "6f3857bd-08bc-4ee4-a39a-331ef661cbbd"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:43:19.870142 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:43:19.870142 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:43:19.879269 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-e202cd1b-bbe9-473b-b296-b82503766fcc req-5ccf8572-07f8-4382-9099-5dc3c24ab62d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:19.879759 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-e202cd1b-bbe9-473b-b296-b82503766fcc req-5ccf8572-07f8-4382-9099-5dc3c24ab62d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:19.892787 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-e202cd1b-bbe9-473b-b296-b82503766fcc req-5ccf8572-07f8-4382-9099-5dc3c24ab62d service nova] Creating event network-vif-plugged:6f3857bd-08bc-4ee4-a39a-331ef661cbbd for instance 1a6650f0-499e-492c-bb9f-6424e765a81b on hv-cinder-81764 Nov 11 20:43:19.898105 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-e202cd1b-bbe9-473b-b296-b82503766fcc req-5ccf8572-07f8-4382-9099-5dc3c24ab62d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034030 Nov 11 20:43:19.898738 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 588/1055] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:43:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:43:20.575767 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-bfd087ce-d8b9-4649-aa1f-54a79a71115a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:20.576442 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-bfd087ce-d8b9-4649-aa1f-54a79a71115a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:20.582549 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bfd087ce-d8b9-4649-aa1f-54a79a71115a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:20.583004 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bfd087ce-d8b9-4649-aa1f-54a79a71115a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:20.584085 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bfd087ce-d8b9-4649-aa1f-54a79a71115a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:20.584521 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bfd087ce-d8b9-4649-aa1f-54a79a71115a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:20.638260 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cb2da7a0-b9e8-45fd-9aff-0f12ce4eda2a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:20.638951 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cb2da7a0-b9e8-45fd-9aff-0f12ce4eda2a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:20.645448 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb2da7a0-b9e8-45fd-9aff-0f12ce4eda2a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:20.645880 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb2da7a0-b9e8-45fd-9aff-0f12ce4eda2a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:20.646666 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb2da7a0-b9e8-45fd-9aff-0f12ce4eda2a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:20.647177 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb2da7a0-b9e8-45fd-9aff-0f12ce4eda2a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:20.749873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-bfd087ce-d8b9-4649-aa1f-54a79a71115a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:20.757826 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-bfd087ce-d8b9-4649-aa1f-54a79a71115a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.186953 Nov 11 20:43:20.758405 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 468/1056] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:20 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:20.797872 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c187a482-c420-4b5f-9288-4d297b908d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:20.798472 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c187a482-c420-4b5f-9288-4d297b908d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:20.804226 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c187a482-c420-4b5f-9288-4d297b908d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:20.804672 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c187a482-c420-4b5f-9288-4d297b908d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:20.805441 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c187a482-c420-4b5f-9288-4d297b908d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:20.805873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c187a482-c420-4b5f-9288-4d297b908d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:20.814541 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cb2da7a0-b9e8-45fd-9aff-0f12ce4eda2a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:20.821826 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cb2da7a0-b9e8-45fd-9aff-0f12ce4eda2a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.188339 Nov 11 20:43:20.822398 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 589/1057] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:20 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:20.938844 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c187a482-c420-4b5f-9288-4d297b908d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:20.946057 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c187a482-c420-4b5f-9288-4d297b908d94 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.151826 Nov 11 20:43:20.946628 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 469/1058] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:20 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:21.775407 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-28edc106-59d3-4c87-b352-d08e9c78366a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:21.776595 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-28edc106-59d3-4c87-b352-d08e9c78366a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:21.782872 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-28edc106-59d3-4c87-b352-d08e9c78366a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:21.783321 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-28edc106-59d3-4c87-b352-d08e9c78366a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:21.784158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-28edc106-59d3-4c87-b352-d08e9c78366a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:21.784592 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-28edc106-59d3-4c87-b352-d08e9c78366a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:21.840193 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2c713fa8-224f-4a4e-8867-cc308372c46b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:21.840806 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2c713fa8-224f-4a4e-8867-cc308372c46b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:21.847131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2c713fa8-224f-4a4e-8867-cc308372c46b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:21.847580 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2c713fa8-224f-4a4e-8867-cc308372c46b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:21.848474 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2c713fa8-224f-4a4e-8867-cc308372c46b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:21.848952 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2c713fa8-224f-4a4e-8867-cc308372c46b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:21.943880 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-28edc106-59d3-4c87-b352-d08e9c78366a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:21.952756 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-28edc106-59d3-4c87-b352-d08e9c78366a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.181130 Nov 11 20:43:21.953325 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 590/1059] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:21 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:21.962425 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e22e0b3f-3461-4ad6-83be-50bd5aad42a0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:21.963033 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e22e0b3f-3461-4ad6-83be-50bd5aad42a0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:21.971131 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e22e0b3f-3461-4ad6-83be-50bd5aad42a0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:21.971571 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e22e0b3f-3461-4ad6-83be-50bd5aad42a0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:21.972388 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e22e0b3f-3461-4ad6-83be-50bd5aad42a0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:21.972814 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e22e0b3f-3461-4ad6-83be-50bd5aad42a0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:22.028854 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-2c713fa8-224f-4a4e-8867-cc308372c46b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:22.036448 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2c713fa8-224f-4a4e-8867-cc308372c46b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1265 microversion: 2.1 time: 0.200708 Nov 11 20:43:22.037116 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 470/1060] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:21 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:22.118054 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e22e0b3f-3461-4ad6-83be-50bd5aad42a0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:22.128171 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e22e0b3f-3461-4ad6-83be-50bd5aad42a0 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1522 microversion: 2.1 time: 0.169566 Nov 11 20:43:22.128752 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 591/1061] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:21 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:22.857168 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-bef66265-dac0-4d35-958a-c48cdaa10157 req-15e9240d-d4b7-4e64-b7c3-7d070f96faee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd75246-98f4-4479-be99-f39c6427cc92", "name": "network-vif-deleted", "tag": "66b27c9f-82a4-466b-830b-548c3a8a129f"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:43:22.858925 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:43:22.858925 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:43:22.866437 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-bef66265-dac0-4d35-958a-c48cdaa10157 req-15e9240d-d4b7-4e64-b7c3-7d070f96faee service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:22.866880 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-bef66265-dac0-4d35-958a-c48cdaa10157 req-15e9240d-d4b7-4e64-b7c3-7d070f96faee service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:22.877999 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-bef66265-dac0-4d35-958a-c48cdaa10157 req-15e9240d-d4b7-4e64-b7c3-7d070f96faee service nova] Creating event network-vif-deleted:66b27c9f-82a4-466b-830b-548c3a8a129f for instance ddd75246-98f4-4479-be99-f39c6427cc92 on hv-cinder-81764 Nov 11 20:43:22.882755 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-bef66265-dac0-4d35-958a-c48cdaa10157 req-15e9240d-d4b7-4e64-b7c3-7d070f96faee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029936 Nov 11 20:43:22.883345 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 471/1062] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:43:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:43:22.970814 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7ba03356-8950-4b21-97dc-0a7c6246431b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:22.971450 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7ba03356-8950-4b21-97dc-0a7c6246431b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:22.977957 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7ba03356-8950-4b21-97dc-0a7c6246431b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:22.978416 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7ba03356-8950-4b21-97dc-0a7c6246431b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:22.980001 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7ba03356-8950-4b21-97dc-0a7c6246431b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:22.980558 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7ba03356-8950-4b21-97dc-0a7c6246431b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:23.053874 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e03cb460-1863-4a1d-909f-a4e7ff3f41f2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:23.054707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e03cb460-1863-4a1d-909f-a4e7ff3f41f2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:23.061717 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e03cb460-1863-4a1d-909f-a4e7ff3f41f2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:23.062165 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e03cb460-1863-4a1d-909f-a4e7ff3f41f2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:23.063168 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e03cb460-1863-4a1d-909f-a4e7ff3f41f2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:23.063606 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e03cb460-1863-4a1d-909f-a4e7ff3f41f2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:23.155047 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7ba03356-8950-4b21-97dc-0a7c6246431b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:23.161998 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7ba03356-8950-4b21-97dc-0a7c6246431b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1722 microversion: 2.1 time: 0.195082 Nov 11 20:43:23.162579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 592/1063] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:22 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:23.226429 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e03cb460-1863-4a1d-909f-a4e7ff3f41f2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:23.234470 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e03cb460-1863-4a1d-909f-a4e7ff3f41f2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1452 microversion: 2.1 time: 0.184553 Nov 11 20:43:23.235128 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 472/1064] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:23 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:43:23.251158 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-240befbb-9735-410e-bddc-ea4f413cade5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:23.251764 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-240befbb-9735-410e-bddc-ea4f413cade5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:23.258158 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-240befbb-9735-410e-bddc-ea4f413cade5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:23.258806 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-240befbb-9735-410e-bddc-ea4f413cade5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:23.259756 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-240befbb-9735-410e-bddc-ea4f413cade5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:23.261055 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-240befbb-9735-410e-bddc-ea4f413cade5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:23.278628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-eb5fab12-3edb-4976-9a80-41e8e372d392 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:23.279336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-eb5fab12-3edb-4976-9a80-41e8e372d392 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:23.285138 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eb5fab12-3edb-4976-9a80-41e8e372d392 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:23.285664 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eb5fab12-3edb-4976-9a80-41e8e372d392 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:23.286541 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eb5fab12-3edb-4976-9a80-41e8e372d392 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:23.287049 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eb5fab12-3edb-4976-9a80-41e8e372d392 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:23.319269 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eb5fab12-3edb-4976-9a80-41e8e372d392 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:23.319732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eb5fab12-3edb-4976-9a80-41e8e372d392 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:23.320295 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-eb5fab12-3edb-4976-9a80-41e8e372d392 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lazy-loading 'fault' on Instance uuid ddd75246-98f4-4479-be99-f39c6427cc92 {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:43:23.373517 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-eb5fab12-3edb-4976-9a80-41e8e372d392 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f969040e0245d9a4894bd40ed8f72f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8473830434694f05acc123584bf48e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:23.380806 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-eb5fab12-3edb-4976-9a80-41e8e372d392 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 200 len: 1312 microversion: 2.1 time: 0.217276 Nov 11 20:43:23.381377 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 593/1065] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:23 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 1312 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:23.394607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7174ad6a-0685-4cee-86fc-282d614feb6d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:23.395097 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7174ad6a-0685-4cee-86fc-282d614feb6d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:23.402554 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7174ad6a-0685-4cee-86fc-282d614feb6d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:23.403251 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7174ad6a-0685-4cee-86fc-282d614feb6d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:23.404074 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7174ad6a-0685-4cee-86fc-282d614feb6d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:23.404511 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7174ad6a-0685-4cee-86fc-282d614feb6d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:23.420870 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-240befbb-9735-410e-bddc-ea4f413cade5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:23.428160 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-240befbb-9735-410e-bddc-ea4f413cade5 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1452 microversion: 2.1 time: 0.180781 Nov 11 20:43:23.428730 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 473/1066] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:23 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:23.485698 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-7174ad6a-0685-4cee-86fc-282d614feb6d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lazy-loading 'services' on Instance uuid f8e8e904-4a99-4f15-bb67-de6de15ca227 {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:43:23.558607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7174ad6a-0685-4cee-86fc-282d614feb6d tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227/os-volume_attachments/b9c90a42-775a-4b9a-8440-73ad137a75ca" status: 202 len: 0 microversion: 2.1 time: 0.175944 Nov 11 20:43:23.559201 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 594/1067] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Nov 11 20:43:23 2021] DELETE /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227/os-volume_attachments/b9c90a42-775a-4b9a-8440-73ad137a75ca => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:43:24.178791 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b868cb08-9e98-4724-976c-34110ac36955 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:24.179529 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b868cb08-9e98-4724-976c-34110ac36955 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:24.186568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b868cb08-9e98-4724-976c-34110ac36955 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:24.187017 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b868cb08-9e98-4724-976c-34110ac36955 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:24.187792 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b868cb08-9e98-4724-976c-34110ac36955 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:24.188263 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b868cb08-9e98-4724-976c-34110ac36955 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:24.399424 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-60c98d0b-5b7b-4741-9ff5-425ff1d3c0e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:24.400163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-60c98d0b-5b7b-4741-9ff5-425ff1d3c0e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] [instance: ddd75246-98f4-4479-be99-f39c6427cc92] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:24.407142 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-60c98d0b-5b7b-4741-9ff5-425ff1d3c0e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:24.407591 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-60c98d0b-5b7b-4741-9ff5-425ff1d3c0e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:24.408434 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-60c98d0b-5b7b-4741-9ff5-425ff1d3c0e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:24.408900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-60c98d0b-5b7b-4741-9ff5-425ff1d3c0e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:24.422988 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-60c98d0b-5b7b-4741-9ff5-425ff1d3c0e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] HTTP exception thrown: Instance ddd75246-98f4-4479-be99-f39c6427cc92 could not be found. Nov 11 20:43:24.423575 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-60c98d0b-5b7b-4741-9ff5-425ff1d3c0e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] Returning 404 to user: Instance ddd75246-98f4-4479-be99-f39c6427cc92 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:43:24.424463 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-60c98d0b-5b7b-4741-9ff5-425ff1d3c0e3 tempest-ServerRescueNegativeTestJSON-1112588542 tempest-ServerRescueNegativeTestJSON-1112588542-project] 10.222.0.61 "GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92" status: 404 len: 111 microversion: 2.1 time: 0.029759 Nov 11 20:43:24.425013 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 595/1068] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:24 2021] GET /compute/v2.1/servers/ddd75246-98f4-4479-be99-f39c6427cc92 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 11 20:43:24.449608 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b868cb08-9e98-4724-976c-34110ac36955 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:24.460329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b868cb08-9e98-4724-976c-34110ac36955 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1699 microversion: 2.1 time: 0.285314 Nov 11 20:43:24.466669 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 474/1069] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:24 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1699 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:24.477854 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-510e93ec-c648-40af-9cab-f11b7c28a153 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:43:24.484858 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-510e93ec-c648-40af-9cab-f11b7c28a153 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:24.485312 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-510e93ec-c648-40af-9cab-f11b7c28a153 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:24.511009 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-510e93ec-c648-40af-9cab-f11b7c28a153 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Going to try to start instance {{(pid=122526) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 11 20:43:24.556331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-510e93ec-c648-40af-9cab-f11b7c28a153 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 202 len: 0 microversion: 2.1 time: 0.082490 Nov 11 20:43:24.557351 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 596/1070] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:43:24 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:43:24.565029 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b914222a-bb88-47e8-ab4b-c04dc9146bdf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:24.565803 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b914222a-bb88-47e8-ab4b-c04dc9146bdf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:24.574075 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b914222a-bb88-47e8-ab4b-c04dc9146bdf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:24.574656 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b914222a-bb88-47e8-ab4b-c04dc9146bdf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:24.575705 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b914222a-bb88-47e8-ab4b-c04dc9146bdf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:24.576649 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b914222a-bb88-47e8-ab4b-c04dc9146bdf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:25.237598 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b914222a-bb88-47e8-ab4b-c04dc9146bdf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:25.247756 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b914222a-bb88-47e8-ab4b-c04dc9146bdf tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1708 microversion: 2.1 time: 0.686508 Nov 11 20:43:25.248752 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 475/1071] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:24 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1708 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:25.749959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4f61e6fe-0255-4592-9187-4b4e8c3b8cef tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:25.751097 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4f61e6fe-0255-4592-9187-4b4e8c3b8cef tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:25.758770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4f61e6fe-0255-4592-9187-4b4e8c3b8cef tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:25.759437 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4f61e6fe-0255-4592-9187-4b4e8c3b8cef tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:25.761260 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4f61e6fe-0255-4592-9187-4b4e8c3b8cef tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:25.761907 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4f61e6fe-0255-4592-9187-4b4e8c3b8cef tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:25.790137 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4f61e6fe-0255-4592-9187-4b4e8c3b8cef tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Going to try to terminate instance {{(pid=122526) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:43:25.887424 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4f61e6fe-0255-4592-9187-4b4e8c3b8cef tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 204 len: 0 microversion: 2.1 time: 0.141944 Nov 11 20:43:25.888678 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 597/1072] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:43:25 2021] DELETE /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:43:25.896855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3defb1bc-437d-4c22-ab44-bec3a0020978 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:25.897460 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3defb1bc-437d-4c22-ab44-bec3a0020978 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:25.908275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3defb1bc-437d-4c22-ab44-bec3a0020978 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:25.908808 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3defb1bc-437d-4c22-ab44-bec3a0020978 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:25.913772 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3defb1bc-437d-4c22-ab44-bec3a0020978 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:25.914874 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3defb1bc-437d-4c22-ab44-bec3a0020978 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:26.175589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-ddf36a55-eee3-450f-828a-66eb263158ba req-38ce7099-0c49-44dc-b32d-c845ab7ef8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6650f0-499e-492c-bb9f-6424e765a81b", "tag": "6f3857bd-08bc-4ee4-a39a-331ef661cbbd"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:43:26.178019 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:43:26.178019 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:43:26.189633 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3defb1bc-437d-4c22-ab44-bec3a0020978 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:26.193002 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-ddf36a55-eee3-450f-828a-66eb263158ba req-38ce7099-0c49-44dc-b32d-c845ab7ef8d3 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:26.206942 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-ddf36a55-eee3-450f-828a-66eb263158ba req-38ce7099-0c49-44dc-b32d-c845ab7ef8d3 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:26.214943 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3defb1bc-437d-4c22-ab44-bec3a0020978 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1514 microversion: 2.1 time: 0.322173 Nov 11 20:43:26.216220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 476/1073] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:25 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:26.227390 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-ddf36a55-eee3-450f-828a-66eb263158ba req-38ce7099-0c49-44dc-b32d-c845ab7ef8d3 service nova] Creating event network-changed:6f3857bd-08bc-4ee4-a39a-331ef661cbbd for instance 1a6650f0-499e-492c-bb9f-6424e765a81b on hv-cinder-81764 Nov 11 20:43:26.237102 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-ddf36a55-eee3-450f-828a-66eb263158ba req-38ce7099-0c49-44dc-b32d-c845ab7ef8d3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065332 Nov 11 20:43:26.237999 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 598/1074] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:43:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:43:26.266532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-298010f1-a026-48c6-a814-c2f2582b880e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:26.267112 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-298010f1-a026-48c6-a814-c2f2582b880e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:26.272979 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-298010f1-a026-48c6-a814-c2f2582b880e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:26.273739 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-298010f1-a026-48c6-a814-c2f2582b880e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:26.274699 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-298010f1-a026-48c6-a814-c2f2582b880e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:26.275137 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-298010f1-a026-48c6-a814-c2f2582b880e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:26.667863 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-298010f1-a026-48c6-a814-c2f2582b880e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:26.681027 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-298010f1-a026-48c6-a814-c2f2582b880e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1708 microversion: 2.1 time: 0.418477 Nov 11 20:43:26.693926 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 477/1075] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:26 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1708 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:27.243139 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-111dd139-1547-488d-8cab-c07a2328e370 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:27.243844 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-111dd139-1547-488d-8cab-c07a2328e370 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:27.251033 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-111dd139-1547-488d-8cab-c07a2328e370 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:27.251471 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-111dd139-1547-488d-8cab-c07a2328e370 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:27.252286 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-111dd139-1547-488d-8cab-c07a2328e370 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:27.252714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-111dd139-1547-488d-8cab-c07a2328e370 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:27.601801 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-111dd139-1547-488d-8cab-c07a2328e370 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:27.610428 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-111dd139-1547-488d-8cab-c07a2328e370 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1514 microversion: 2.1 time: 0.372156 Nov 11 20:43:27.615101 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 599/1076] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:27 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1514 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:27.698925 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a24ecdd4-91ac-485d-b3e9-0eef7e391769 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:27.699551 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a24ecdd4-91ac-485d-b3e9-0eef7e391769 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:27.705691 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a24ecdd4-91ac-485d-b3e9-0eef7e391769 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:27.706145 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a24ecdd4-91ac-485d-b3e9-0eef7e391769 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:27.706918 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a24ecdd4-91ac-485d-b3e9-0eef7e391769 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:27.707376 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a24ecdd4-91ac-485d-b3e9-0eef7e391769 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:28.047174 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a24ecdd4-91ac-485d-b3e9-0eef7e391769 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:28.055884 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a24ecdd4-91ac-485d-b3e9-0eef7e391769 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1712 microversion: 2.1 time: 0.361106 Nov 11 20:43:28.068352 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 478/1077] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:27 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1712 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:28.632358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c2603b83-238a-4d71-9670-54cf09314ff0 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:28.632971 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c2603b83-238a-4d71-9670-54cf09314ff0 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:28.640204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c2603b83-238a-4d71-9670-54cf09314ff0 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:28.640760 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c2603b83-238a-4d71-9670-54cf09314ff0 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:28.641552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c2603b83-238a-4d71-9670-54cf09314ff0 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:28.642020 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c2603b83-238a-4d71-9670-54cf09314ff0 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:28.778622 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c2603b83-238a-4d71-9670-54cf09314ff0 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:28.786220 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c2603b83-238a-4d71-9670-54cf09314ff0 tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1514 microversion: 2.1 time: 0.157630 Nov 11 20:43:28.786826 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 600/1078] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:28 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:29.804084 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9291710b-7fe3-4545-80f5-3c268d7eefdd tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:29.804729 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9291710b-7fe3-4545-80f5-3c268d7eefdd tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:29.818194 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9291710b-7fe3-4545-80f5-3c268d7eefdd tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:29.819093 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9291710b-7fe3-4545-80f5-3c268d7eefdd tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:29.819944 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9291710b-7fe3-4545-80f5-3c268d7eefdd tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:29.820439 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9291710b-7fe3-4545-80f5-3c268d7eefdd tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:30.066497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-86cd3306-1330-440e-956d-a00ad056c9fa req-d206ea3d-e6b0-4332-bbe7-fa7d2591df6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e8e904-4a99-4f15-bb67-de6de15ca227", "name": "network-vif-deleted", "tag": "264d6612-f400-47b2-8c4e-bdd88f54e280"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:43:30.068384 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:43:30.068384 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:43:30.072354 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9291710b-7fe3-4545-80f5-3c268d7eefdd tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b39b9079633437aad9181c339fee6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9bb6fc32584e87808c292a94dd546d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:43:30.078864 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-86cd3306-1330-440e-956d-a00ad056c9fa req-d206ea3d-e6b0-4332-bbe7-fa7d2591df6d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:30.079721 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-86cd3306-1330-440e-956d-a00ad056c9fa req-d206ea3d-e6b0-4332-bbe7-fa7d2591df6d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:30.081697 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9291710b-7fe3-4545-80f5-3c268d7eefdd tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 200 len: 1514 microversion: 2.1 time: 0.281456 Nov 11 20:43:30.082290 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 479/1079] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:29 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 1514 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:43:30.094022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-86cd3306-1330-440e-956d-a00ad056c9fa req-d206ea3d-e6b0-4332-bbe7-fa7d2591df6d service nova] Creating event network-vif-deleted:264d6612-f400-47b2-8c4e-bdd88f54e280 for instance f8e8e904-4a99-4f15-bb67-de6de15ca227 on hv-cinder-81764 Nov 11 20:43:30.098950 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-86cd3306-1330-440e-956d-a00ad056c9fa req-d206ea3d-e6b0-4332-bbe7-fa7d2591df6d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036263 Nov 11 20:43:30.099546 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 601/1080] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:43:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:43:31.100151 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5038b923-6574-4c70-924e-87171e4b130f tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:43:31.100819 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5038b923-6574-4c70-924e-87171e4b130f tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] [instance: f8e8e904-4a99-4f15-bb67-de6de15ca227] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:43:31.109432 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5038b923-6574-4c70-924e-87171e4b130f tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:31.109432 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5038b923-6574-4c70-924e-87171e4b130f tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:31.109432 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5038b923-6574-4c70-924e-87171e4b130f tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:43:31.109712 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5038b923-6574-4c70-924e-87171e4b130f tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:43:31.124851 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-5038b923-6574-4c70-924e-87171e4b130f tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] HTTP exception thrown: Instance f8e8e904-4a99-4f15-bb67-de6de15ca227 could not be found. Nov 11 20:43:31.125448 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5038b923-6574-4c70-924e-87171e4b130f tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] Returning 404 to user: Instance f8e8e904-4a99-4f15-bb67-de6de15ca227 could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:43:31.126442 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5038b923-6574-4c70-924e-87171e4b130f tempest-VolumesSnapshotTestJSON-1593594218 tempest-VolumesSnapshotTestJSON-1593594218-project] 10.222.0.61 "GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227" status: 404 len: 111 microversion: 2.1 time: 0.030177 Nov 11 20:43:31.126826 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 480/1081] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:43:31 2021] GET /compute/v2.1/servers/f8e8e904-4a99-4f15-bb67-de6de15ca227 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:44:27.592079 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fb3ca4ca-12bd-4fe4-bb6c-562e9e8fb94d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1799895099"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:44:27.592751 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fb3ca4ca-12bd-4fe4-bb6c-562e9e8fb94d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:27.600531 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fb3ca4ca-12bd-4fe4-bb6c-562e9e8fb94d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:27.600987 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fb3ca4ca-12bd-4fe4-bb6c-562e9e8fb94d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:27.601789 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fb3ca4ca-12bd-4fe4-bb6c-562e9e8fb94d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:27.602352 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fb3ca4ca-12bd-4fe4-bb6c-562e9e8fb94d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:27.778363 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.network.security_group_api [None req-fb3ca4ca-12bd-4fe4-bb6c-562e9e8fb94d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Removing security group c06bf615-ba67-4bf3-8987-cd2a1eab332f from port 30542ce7-fdf6-41e0-981e-8ee1bf98723f Nov 11 20:44:28.304793 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fb3ca4ca-12bd-4fe4-bb6c-562e9e8fb94d tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "POST /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/action" status: 202 len: 0 microversion: 2.1 time: 1.138491 Nov 11 20:44:28.305649 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 602/1082] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:44:27 2021] POST /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/action => generated 0 bytes in 1140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:44:28.469129 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-fe2d6343-57b4-4348-890a-cc07ab321a42 req-e77ecef4-a871-4b93-bbe2-9c34ae561b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28d94ff-cfbb-46b3-b20d-32a6cb35893e", "tag": "30542ce7-fdf6-41e0-981e-8ee1bf98723f"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:44:28.472129 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:44:28.472129 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:44:28.479932 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-fe2d6343-57b4-4348-890a-cc07ab321a42 req-e77ecef4-a871-4b93-bbe2-9c34ae561b79 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:28.480787 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-fe2d6343-57b4-4348-890a-cc07ab321a42 req-e77ecef4-a871-4b93-bbe2-9c34ae561b79 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:28.494169 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-fe2d6343-57b4-4348-890a-cc07ab321a42 req-e77ecef4-a871-4b93-bbe2-9c34ae561b79 service nova] Creating event network-changed:30542ce7-fdf6-41e0-981e-8ee1bf98723f for instance d28d94ff-cfbb-46b3-b20d-32a6cb35893e on hv-cinder-81764 Nov 11 20:44:28.501959 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-fe2d6343-57b4-4348-890a-cc07ab321a42 req-e77ecef4-a871-4b93-bbe2-9c34ae561b79 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182723 Nov 11 20:44:28.506481 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 481/1083] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:44:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:44:28.785517 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c36bde9a-7a0c-4318-977a-88f7bacf41af tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Action: 'create', calling method: .version_select at 0x7ff3ed973af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1324740347"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:44:28.810555 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-c36bde9a-7a0c-4318-977a-88f7bacf41af tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Getting quotas for project 1ad6c752ea6048068ad66bddb0f2968f. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:44:28.815812 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-c36bde9a-7a0c-4318-977a-88f7bacf41af tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Getting quotas for user f04ea153f3a44236a3cc29bb26dcacbd and project 1ad6c752ea6048068ad66bddb0f2968f. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:44:29.014570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-c36bde9a-7a0c-4318-977a-88f7bacf41af tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Getting quotas for project 1ad6c752ea6048068ad66bddb0f2968f. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:44:29.019672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-c36bde9a-7a0c-4318-977a-88f7bacf41af tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Getting quotas for user f04ea153f3a44236a3cc29bb26dcacbd and project 1ad6c752ea6048068ad66bddb0f2968f. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:44:29.036856 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c36bde9a-7a0c-4318-977a-88f7bacf41af tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.401648 Nov 11 20:44:29.038225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 603/1084] 10.222.0.61 () {60 vars in 1157 bytes} [Thu Nov 11 20:44:28 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:29.869869 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3eb6240d-555a-42d0-9b86-203f732f03e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:29.870447 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3eb6240d-555a-42d0-9b86-203f732f03e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:29.883306 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3eb6240d-555a-42d0-9b86-203f732f03e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:29.884196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3eb6240d-555a-42d0-9b86-203f732f03e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:29.885170 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3eb6240d-555a-42d0-9b86-203f732f03e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:29.885765 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3eb6240d-555a-42d0-9b86-203f732f03e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:29.958845 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-f2ad4394-6e7e-4743-ad56-ab82292737e3 req-2972b8e6-a124-4c28-a3e6-cd19bfb947cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28d94ff-cfbb-46b3-b20d-32a6cb35893e", "tag": "30542ce7-fdf6-41e0-981e-8ee1bf98723f"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:44:29.960856 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:44:29.960856 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:44:29.985169 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-f2ad4394-6e7e-4743-ad56-ab82292737e3 req-2972b8e6-a124-4c28-a3e6-cd19bfb947cf service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:29.991090 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-f2ad4394-6e7e-4743-ad56-ab82292737e3 req-2972b8e6-a124-4c28-a3e6-cd19bfb947cf service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:30.018033 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.objects.instance [None req-3eb6240d-555a-42d0-9b86-203f732f03e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lazy-loading 'services' on Instance uuid d28d94ff-cfbb-46b3-b20d-32a6cb35893e {{(pid=122527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:44:30.019203 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-f2ad4394-6e7e-4743-ad56-ab82292737e3 req-2972b8e6-a124-4c28-a3e6-cd19bfb947cf service nova] Creating event network-changed:30542ce7-fdf6-41e0-981e-8ee1bf98723f for instance d28d94ff-cfbb-46b3-b20d-32a6cb35893e on hv-cinder-81764 Nov 11 20:44:30.024931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-f2ad4394-6e7e-4743-ad56-ab82292737e3 req-2972b8e6-a124-4c28-a3e6-cd19bfb947cf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156714 Nov 11 20:44:30.026244 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 604/1085] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:44:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:44:30.153931 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3eb6240d-555a-42d0-9b86-203f732f03e9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/os-volume_attachments/1f39b2f7-ac04-4358-9568-a21ddc8c5973" status: 202 len: 0 microversion: 2.1 time: 0.288116 Nov 11 20:44:30.165212 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 482/1086] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Nov 11 20:44:29 2021] DELETE /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/os-volume_attachments/1f39b2f7-ac04-4358-9568-a21ddc8c5973 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:44:30.179205 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e77890b3-1fbc-4f6b-ae35-7a1ed22a8d15 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:30.182622 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e77890b3-1fbc-4f6b-ae35-7a1ed22a8d15 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:30.201577 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e77890b3-1fbc-4f6b-ae35-7a1ed22a8d15 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:30.218725 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e77890b3-1fbc-4f6b-ae35-7a1ed22a8d15 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:30.222035 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e77890b3-1fbc-4f6b-ae35-7a1ed22a8d15 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:30.223448 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e77890b3-1fbc-4f6b-ae35-7a1ed22a8d15 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:30.266246 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e77890b3-1fbc-4f6b-ae35-7a1ed22a8d15 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103152 Nov 11 20:44:30.267383 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 605/1087] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:44:30 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:44:31.280317 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-39ba7b9f-a76b-4804-81b4-074674214456 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:31.282227 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-39ba7b9f-a76b-4804-81b4-074674214456 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:31.294263 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-39ba7b9f-a76b-4804-81b4-074674214456 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:31.294922 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-39ba7b9f-a76b-4804-81b4-074674214456 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:31.296543 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-39ba7b9f-a76b-4804-81b4-074674214456 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:31.297058 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-39ba7b9f-a76b-4804-81b4-074674214456 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:31.327234 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-39ba7b9f-a76b-4804-81b4-074674214456 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051519 Nov 11 20:44:31.328276 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 483/1088] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:44:31 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:44:32.339151 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1efa377d-2bc5-4dd3-a23d-781888bef11e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:32.340208 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1efa377d-2bc5-4dd3-a23d-781888bef11e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:32.347714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1efa377d-2bc5-4dd3-a23d-781888bef11e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:32.348210 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1efa377d-2bc5-4dd3-a23d-781888bef11e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:32.348995 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1efa377d-2bc5-4dd3-a23d-781888bef11e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:32.349436 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1efa377d-2bc5-4dd3-a23d-781888bef11e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:32.378077 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1efa377d-2bc5-4dd3-a23d-781888bef11e tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043202 Nov 11 20:44:32.379020 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 606/1089] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:44:32 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:44:32.388329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0e95a8b5-32bf-4d5d-ba6f-f56cfde6cac2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:32.388869 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0e95a8b5-32bf-4d5d-ba6f-f56cfde6cac2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:32.396337 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0e95a8b5-32bf-4d5d-ba6f-f56cfde6cac2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:32.396785 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0e95a8b5-32bf-4d5d-ba6f-f56cfde6cac2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:32.397589 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0e95a8b5-32bf-4d5d-ba6f-f56cfde6cac2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:32.398019 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0e95a8b5-32bf-4d5d-ba6f-f56cfde6cac2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:32.474710 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-0e95a8b5-32bf-4d5d-ba6f-f56cfde6cac2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] HTTP exception thrown: Instance d28d94ff-cfbb-46b3-b20d-32a6cb35893e is not attached to volume 1f39b2f7-ac04-4358-9568-a21ddc8c5973 Nov 11 20:44:32.475329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0e95a8b5-32bf-4d5d-ba6f-f56cfde6cac2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Returning 404 to user: Instance d28d94ff-cfbb-46b3-b20d-32a6cb35893e is not attached to volume 1f39b2f7-ac04-4358-9568-a21ddc8c5973 {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:44:32.476222 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0e95a8b5-32bf-4d5d-ba6f-f56cfde6cac2 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/os-volume_attachments/1f39b2f7-ac04-4358-9568-a21ddc8c5973" status: 404 len: 154 microversion: 2.1 time: 0.091749 Nov 11 20:44:32.477125 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 484/1090] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Nov 11 20:44:32 2021] DELETE /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e/os-volume_attachments/1f39b2f7-ac04-4358-9568-a21ddc8c5973 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:44:33.623747 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8a5b6f93-dd0c-4acc-a2e3-8bf424235da9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:33.629794 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8a5b6f93-dd0c-4acc-a2e3-8bf424235da9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:33.636641 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8a5b6f93-dd0c-4acc-a2e3-8bf424235da9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:33.637289 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8a5b6f93-dd0c-4acc-a2e3-8bf424235da9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:33.638214 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8a5b6f93-dd0c-4acc-a2e3-8bf424235da9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:33.639042 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8a5b6f93-dd0c-4acc-a2e3-8bf424235da9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:33.670391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8a5b6f93-dd0c-4acc-a2e3-8bf424235da9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Going to try to terminate instance {{(pid=122526) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:44:33.776126 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8a5b6f93-dd0c-4acc-a2e3-8bf424235da9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 204 len: 0 microversion: 2.1 time: 0.157463 Nov 11 20:44:33.776922 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 607/1091] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:44:33 2021] DELETE /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:44:33.785349 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-18bc9058-8dd2-424b-b8fb-d6201e7c8bbb tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:33.786016 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-18bc9058-8dd2-424b-b8fb-d6201e7c8bbb tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:33.800526 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-18bc9058-8dd2-424b-b8fb-d6201e7c8bbb tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:33.800961 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-18bc9058-8dd2-424b-b8fb-d6201e7c8bbb tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:33.801761 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-18bc9058-8dd2-424b-b8fb-d6201e7c8bbb tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:33.802198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-18bc9058-8dd2-424b-b8fb-d6201e7c8bbb tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:34.013958 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-18bc9058-8dd2-424b-b8fb-d6201e7c8bbb tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:34.026889 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-18bc9058-8dd2-424b-b8fb-d6201e7c8bbb tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1554 microversion: 2.1 time: 0.245255 Nov 11 20:44:34.027867 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 485/1092] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:33 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:44:35.046385 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7d6305f0-83c7-49a6-9571-e3f36a15e3d9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:35.047130 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7d6305f0-83c7-49a6-9571-e3f36a15e3d9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:35.053328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7d6305f0-83c7-49a6-9571-e3f36a15e3d9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:35.053772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7d6305f0-83c7-49a6-9571-e3f36a15e3d9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:35.054553 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7d6305f0-83c7-49a6-9571-e3f36a15e3d9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:35.054991 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7d6305f0-83c7-49a6-9571-e3f36a15e3d9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:35.186032 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7d6305f0-83c7-49a6-9571-e3f36a15e3d9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:35.194056 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7d6305f0-83c7-49a6-9571-e3f36a15e3d9 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1554 microversion: 2.1 time: 0.152246 Nov 11 20:44:35.194614 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 608/1093] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:35 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:36.210252 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ddff663d-2db2-42d5-975c-15dc2d84f679 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:36.210878 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ddff663d-2db2-42d5-975c-15dc2d84f679 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:36.217378 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ddff663d-2db2-42d5-975c-15dc2d84f679 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:36.217939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ddff663d-2db2-42d5-975c-15dc2d84f679 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:36.219044 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ddff663d-2db2-42d5-975c-15dc2d84f679 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:36.219507 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ddff663d-2db2-42d5-975c-15dc2d84f679 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:36.354417 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ddff663d-2db2-42d5-975c-15dc2d84f679 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:36.362934 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ddff663d-2db2-42d5-975c-15dc2d84f679 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1554 microversion: 2.1 time: 0.156389 Nov 11 20:44:36.363497 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 486/1094] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:36 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:37.162058 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-e9f7b188-6ab9-43ba-9a54-8e08d3e38cb1 req-4124bbdc-3e71-4206-8711-b97dfb8fc440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28d94ff-cfbb-46b3-b20d-32a6cb35893e", "name": "network-vif-deleted", "tag": "30542ce7-fdf6-41e0-981e-8ee1bf98723f"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:44:37.164273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:44:37.164273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:44:37.180705 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-e9f7b188-6ab9-43ba-9a54-8e08d3e38cb1 req-4124bbdc-3e71-4206-8711-b97dfb8fc440 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:37.181409 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-e9f7b188-6ab9-43ba-9a54-8e08d3e38cb1 req-4124bbdc-3e71-4206-8711-b97dfb8fc440 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:37.195088 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-e9f7b188-6ab9-43ba-9a54-8e08d3e38cb1 req-4124bbdc-3e71-4206-8711-b97dfb8fc440 service nova] Creating event network-vif-deleted:30542ce7-fdf6-41e0-981e-8ee1bf98723f for instance d28d94ff-cfbb-46b3-b20d-32a6cb35893e on hv-cinder-81764 Nov 11 20:44:37.200518 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-e9f7b188-6ab9-43ba-9a54-8e08d3e38cb1 req-4124bbdc-3e71-4206-8711-b97dfb8fc440 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042125 Nov 11 20:44:37.201110 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 609/1095] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:44:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:44:37.379800 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-bd72fc5a-af4d-40a1-9c47-f1c87fa3c751 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:37.380423 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-bd72fc5a-af4d-40a1-9c47-f1c87fa3c751 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:37.386607 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bd72fc5a-af4d-40a1-9c47-f1c87fa3c751 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:37.387046 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bd72fc5a-af4d-40a1-9c47-f1c87fa3c751 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:37.387811 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bd72fc5a-af4d-40a1-9c47-f1c87fa3c751 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:37.388268 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bd72fc5a-af4d-40a1-9c47-f1c87fa3c751 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:37.420506 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bd72fc5a-af4d-40a1-9c47-f1c87fa3c751 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:37.420953 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bd72fc5a-af4d-40a1-9c47-f1c87fa3c751 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:37.421587 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.objects.instance [None req-bd72fc5a-af4d-40a1-9c47-f1c87fa3c751 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lazy-loading 'fault' on Instance uuid d28d94ff-cfbb-46b3-b20d-32a6cb35893e {{(pid=122527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:44:37.462915 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-bd72fc5a-af4d-40a1-9c47-f1c87fa3c751 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b806e1d785746d8b429046c3d6e41f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3da3f794f742c0a5bf009d5bad5208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:37.471520 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-bd72fc5a-af4d-40a1-9c47-f1c87fa3c751 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 200 len: 1348 microversion: 2.1 time: 0.095404 Nov 11 20:44:37.472477 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 487/1096] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:37 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:38.489554 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f0a976ef-33e5-486f-8cb0-c5b9c64e17b4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:38.490270 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f0a976ef-33e5-486f-8cb0-c5b9c64e17b4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] [instance: d28d94ff-cfbb-46b3-b20d-32a6cb35893e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:38.496817 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f0a976ef-33e5-486f-8cb0-c5b9c64e17b4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:38.497219 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f0a976ef-33e5-486f-8cb0-c5b9c64e17b4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:38.498002 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f0a976ef-33e5-486f-8cb0-c5b9c64e17b4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:38.498437 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f0a976ef-33e5-486f-8cb0-c5b9c64e17b4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:38.512416 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-f0a976ef-33e5-486f-8cb0-c5b9c64e17b4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] HTTP exception thrown: Instance d28d94ff-cfbb-46b3-b20d-32a6cb35893e could not be found. Nov 11 20:44:38.513118 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f0a976ef-33e5-486f-8cb0-c5b9c64e17b4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Returning 404 to user: Instance d28d94ff-cfbb-46b3-b20d-32a6cb35893e could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:44:38.513947 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f0a976ef-33e5-486f-8cb0-c5b9c64e17b4 tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e" status: 404 len: 111 microversion: 2.1 time: 0.029062 Nov 11 20:44:38.518211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 610/1097] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:38 2021] GET /compute/v2.1/servers/d28d94ff-cfbb-46b3-b20d-32a6cb35893e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:44:38.522656 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-da72a165-706f-488f-a98f-00a59dc96bdf tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] Calling method '.version_select at 0x7ff3ed9f8af0>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:38.552846 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-da72a165-706f-488f-a98f-00a59dc96bdf tempest-TestMinimumBasicScenario-1207991584 tempest-TestMinimumBasicScenario-1207991584-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2023468667" status: 202 len: 0 microversion: 2.1 time: 0.033695 Nov 11 20:44:38.553426 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 488/1098] 10.222.0.61 () {58 vars in 1271 bytes} [Thu Nov 11 20:44:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2023468667 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:44:39.684482 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d900379f-675e-42d1-998e-922aad148fea tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:39.685026 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d900379f-675e-42d1-998e-922aad148fea tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:39.691158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d900379f-675e-42d1-998e-922aad148fea tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:39.691596 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d900379f-675e-42d1-998e-922aad148fea tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:39.692413 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d900379f-675e-42d1-998e-922aad148fea tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:39.692936 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d900379f-675e-42d1-998e-922aad148fea tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:39.772353 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-d900379f-675e-42d1-998e-922aad148fea tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lazy-loading 'services' on Instance uuid d03811f1-6242-47b2-be06-1ed656918ccb {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:44:39.849442 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d900379f-675e-42d1-998e-922aad148fea tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/os-volume_attachments/fca51fc9-c775-46e2-9a36-6d66b4712534" status: 202 len: 0 microversion: 2.1 time: 0.168515 Nov 11 20:44:39.850356 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 611/1099] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Nov 11 20:44:39 2021] DELETE /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/os-volume_attachments/fca51fc9-c775-46e2-9a36-6d66b4712534 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:44:40.968708 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3e70d2a3-48b9-4487-a9ad-76be854ce3b3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:44:40.981979 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3e70d2a3-48b9-4487-a9ad-76be854ce3b3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:40.982432 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3e70d2a3-48b9-4487-a9ad-76be854ce3b3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:41.059147 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3e70d2a3-48b9-4487-a9ad-76be854ce3b3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Going to try to stop instance {{(pid=122527) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 11 20:44:41.088906 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-233300fa-d543-47a0-9b44-23dfc47faa2a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:41.089625 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-233300fa-d543-47a0-9b44-23dfc47faa2a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:41.097218 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-233300fa-d543-47a0-9b44-23dfc47faa2a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:41.097706 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-233300fa-d543-47a0-9b44-23dfc47faa2a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:41.098570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-233300fa-d543-47a0-9b44-23dfc47faa2a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:41.099041 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-233300fa-d543-47a0-9b44-23dfc47faa2a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:41.104675 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3e70d2a3-48b9-4487-a9ad-76be854ce3b3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 202 len: 0 microversion: 2.1 time: 0.139611 Nov 11 20:44:41.109425 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 489/1100] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:44:40 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:44:41.124773 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-26da5c86-ca7e-4e06-ae72-3917ee512026 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:41.125778 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-26da5c86-ca7e-4e06-ae72-3917ee512026 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:41.135575 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-26da5c86-ca7e-4e06-ae72-3917ee512026 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:41.136047 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-26da5c86-ca7e-4e06-ae72-3917ee512026 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:41.136910 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-26da5c86-ca7e-4e06-ae72-3917ee512026 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:41.137460 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-26da5c86-ca7e-4e06-ae72-3917ee512026 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:41.167717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-233300fa-d543-47a0-9b44-23dfc47faa2a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments/6ece245e-e030-4b73-89f9-88bc4fe301d0" status: 200 len: 194 microversion: 2.20 time: 0.199886 Nov 11 20:44:41.184652 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 612/1101] 10.222.0.61 () {60 vars in 1453 bytes} [Thu Nov 11 20:44:40 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments/6ece245e-e030-4b73-89f9-88bc4fe301d0 => generated 194 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:44:41.258627 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f814e596-8ba7-4471-bbd9-1fe2fa78a66b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:41.259419 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f814e596-8ba7-4471-bbd9-1fe2fa78a66b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:41.267356 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f814e596-8ba7-4471-bbd9-1fe2fa78a66b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:41.268160 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f814e596-8ba7-4471-bbd9-1fe2fa78a66b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:41.269500 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f814e596-8ba7-4471-bbd9-1fe2fa78a66b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:41.270380 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f814e596-8ba7-4471-bbd9-1fe2fa78a66b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:41.368298 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-f814e596-8ba7-4471-bbd9-1fe2fa78a66b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lazy-loading 'services' on Instance uuid ce4a9f51-80d0-4901-beaf-9b03435f002c {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:44:41.454612 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-26da5c86-ca7e-4e06-ae72-3917ee512026 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:41.466935 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f814e596-8ba7-4471-bbd9-1fe2fa78a66b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments/6ece245e-e030-4b73-89f9-88bc4fe301d0" status: 202 len: 0 microversion: 2.20 time: 0.212033 Nov 11 20:44:41.470738 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-26da5c86-ca7e-4e06-ae72-3917ee512026 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.353588 Nov 11 20:44:41.472597 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 613/1102] 10.222.0.61 () {60 vars in 1456 bytes} [Thu Nov 11 20:44:41 2021] DELETE /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments/6ece245e-e030-4b73-89f9-88bc4fe301d0 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:44:41.474666 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 490/1103] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:41 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:41.491364 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-aab94346-85ae-47c1-b68b-210ce2d45eac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:41.493259 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-aab94346-85ae-47c1-b68b-210ce2d45eac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:41.501685 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aab94346-85ae-47c1-b68b-210ce2d45eac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:41.502474 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aab94346-85ae-47c1-b68b-210ce2d45eac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:41.503486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aab94346-85ae-47c1-b68b-210ce2d45eac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:41.504141 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aab94346-85ae-47c1-b68b-210ce2d45eac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:41.560265 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-aab94346-85ae-47c1-b68b-210ce2d45eac tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073776 Nov 11 20:44:41.568760 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 614/1104] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Nov 11 20:44:41 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:44:42.490461 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-cea9f96f-4bac-4683-9e0d-fb7e08c72647 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:42.491071 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-cea9f96f-4bac-4683-9e0d-fb7e08c72647 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:42.497669 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cea9f96f-4bac-4683-9e0d-fb7e08c72647 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:42.498247 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cea9f96f-4bac-4683-9e0d-fb7e08c72647 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:42.499132 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cea9f96f-4bac-4683-9e0d-fb7e08c72647 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:42.499934 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cea9f96f-4bac-4683-9e0d-fb7e08c72647 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:42.575901 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-08bb0578-53bf-4714-99c3-ebc7e75343b1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:42.576847 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-08bb0578-53bf-4714-99c3-ebc7e75343b1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:42.584206 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-08bb0578-53bf-4714-99c3-ebc7e75343b1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:42.584651 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-08bb0578-53bf-4714-99c3-ebc7e75343b1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:42.585625 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-08bb0578-53bf-4714-99c3-ebc7e75343b1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:42.586054 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-08bb0578-53bf-4714-99c3-ebc7e75343b1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:42.617661 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-08bb0578-53bf-4714-99c3-ebc7e75343b1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045550 Nov 11 20:44:42.618228 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 615/1105] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Nov 11 20:44:42 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:44:42.732910 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cea9f96f-4bac-4683-9e0d-fb7e08c72647 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:42.742350 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-cea9f96f-4bac-4683-9e0d-fb7e08c72647 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.255599 Nov 11 20:44:42.743113 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 491/1106] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:42 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:43.628587 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-aeb5e7e4-a3bf-463f-9057-70296800aacd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:43.629501 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-aeb5e7e4-a3bf-463f-9057-70296800aacd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:43.635687 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aeb5e7e4-a3bf-463f-9057-70296800aacd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:43.636176 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aeb5e7e4-a3bf-463f-9057-70296800aacd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:43.636963 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aeb5e7e4-a3bf-463f-9057-70296800aacd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:43.637531 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-aeb5e7e4-a3bf-463f-9057-70296800aacd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:43.670230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-aeb5e7e4-a3bf-463f-9057-70296800aacd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045302 Nov 11 20:44:43.670722 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 616/1107] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Nov 11 20:44:43 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:44:43.760825 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5071b3d8-f29f-4514-868f-8cc66d18d608 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:43.761992 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5071b3d8-f29f-4514-868f-8cc66d18d608 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:43.774125 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5071b3d8-f29f-4514-868f-8cc66d18d608 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:43.774125 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5071b3d8-f29f-4514-868f-8cc66d18d608 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:43.774125 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5071b3d8-f29f-4514-868f-8cc66d18d608 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:43.774125 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5071b3d8-f29f-4514-868f-8cc66d18d608 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:43.959694 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-5071b3d8-f29f-4514-868f-8cc66d18d608 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:43.971006 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5071b3d8-f29f-4514-868f-8cc66d18d608 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.214434 Nov 11 20:44:43.971596 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 492/1108] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:43 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:44.684501 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bc5f7a50-e2f5-420f-be4d-3a0fba26ac67 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:44.685609 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-bc5f7a50-e2f5-420f-be4d-3a0fba26ac67 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:44.692898 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bc5f7a50-e2f5-420f-be4d-3a0fba26ac67 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:44.693483 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bc5f7a50-e2f5-420f-be4d-3a0fba26ac67 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:44.694350 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bc5f7a50-e2f5-420f-be4d-3a0fba26ac67 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:44.694915 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bc5f7a50-e2f5-420f-be4d-3a0fba26ac67 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:44.726198 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bc5f7a50-e2f5-420f-be4d-3a0fba26ac67 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046086 Nov 11 20:44:44.726810 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 617/1109] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Nov 11 20:44:44 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:44:44.988635 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-66a9bb9d-db35-4076-9345-0637a014cd8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:44.989264 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-66a9bb9d-db35-4076-9345-0637a014cd8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:44.995730 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-66a9bb9d-db35-4076-9345-0637a014cd8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:44.996320 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-66a9bb9d-db35-4076-9345-0637a014cd8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:44.997214 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-66a9bb9d-db35-4076-9345-0637a014cd8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:44.997783 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-66a9bb9d-db35-4076-9345-0637a014cd8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:45.142205 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-66a9bb9d-db35-4076-9345-0637a014cd8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:45.149712 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-66a9bb9d-db35-4076-9345-0637a014cd8b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.166258 Nov 11 20:44:45.150289 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 493/1110] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:44 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:45.738169 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7a717ce2-c59f-4ac5-ad96-b363de222510 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:45.739209 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7a717ce2-c59f-4ac5-ad96-b363de222510 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:45.745904 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7a717ce2-c59f-4ac5-ad96-b363de222510 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:45.746425 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7a717ce2-c59f-4ac5-ad96-b363de222510 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:45.747269 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7a717ce2-c59f-4ac5-ad96-b363de222510 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:45.747772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7a717ce2-c59f-4ac5-ad96-b363de222510 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:45.776962 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7a717ce2-c59f-4ac5-ad96-b363de222510 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043313 Nov 11 20:44:45.777548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 618/1111] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Nov 11 20:44:45 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:44:46.172710 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-359d039e-5ece-46f0-a260-eea133a0e3f6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:46.173367 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-359d039e-5ece-46f0-a260-eea133a0e3f6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:46.181477 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-359d039e-5ece-46f0-a260-eea133a0e3f6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:46.181954 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-359d039e-5ece-46f0-a260-eea133a0e3f6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:46.183024 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-359d039e-5ece-46f0-a260-eea133a0e3f6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:46.184061 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-359d039e-5ece-46f0-a260-eea133a0e3f6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:46.341601 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-359d039e-5ece-46f0-a260-eea133a0e3f6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:46.350390 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-359d039e-5ece-46f0-a260-eea133a0e3f6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.182292 Nov 11 20:44:46.351046 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 494/1112] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:46 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:46.793035 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d1283168-a964-4daa-a5fc-200d1c2bd28a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:46.794035 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d1283168-a964-4daa-a5fc-200d1c2bd28a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:46.801812 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d1283168-a964-4daa-a5fc-200d1c2bd28a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:46.802485 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d1283168-a964-4daa-a5fc-200d1c2bd28a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:46.803499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d1283168-a964-4daa-a5fc-200d1c2bd28a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:46.803964 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d1283168-a964-4daa-a5fc-200d1c2bd28a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:46.837508 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d1283168-a964-4daa-a5fc-200d1c2bd28a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051850 Nov 11 20:44:46.838444 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 619/1113] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Nov 11 20:44:46 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:46.903830 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3adb606b-10a1-4a3d-8a4d-b23dec3c155a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:46.904491 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3adb606b-10a1-4a3d-8a4d-b23dec3c155a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:46.912585 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3adb606b-10a1-4a3d-8a4d-b23dec3c155a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:46.913037 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3adb606b-10a1-4a3d-8a4d-b23dec3c155a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:46.913824 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3adb606b-10a1-4a3d-8a4d-b23dec3c155a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:46.914282 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3adb606b-10a1-4a3d-8a4d-b23dec3c155a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:46.940862 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3adb606b-10a1-4a3d-8a4d-b23dec3c155a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Going to try to terminate instance {{(pid=122527) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:44:47.038967 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3adb606b-10a1-4a3d-8a4d-b23dec3c155a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 204 len: 0 microversion: 2.20 time: 0.138471 Nov 11 20:44:47.039787 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 495/1114] 10.222.0.61 () {60 vars in 1279 bytes} [Thu Nov 11 20:44:46 2021] DELETE /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 11 20:44:47.049137 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-af83d777-b5b6-4c70-b9b7-d65536de7a88 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:47.050013 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-af83d777-b5b6-4c70-b9b7-d65536de7a88 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:47.055911 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af83d777-b5b6-4c70-b9b7-d65536de7a88 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:47.056462 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af83d777-b5b6-4c70-b9b7-d65536de7a88 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:47.057241 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af83d777-b5b6-4c70-b9b7-d65536de7a88 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:47.057671 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af83d777-b5b6-4c70-b9b7-d65536de7a88 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:47.236328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-af83d777-b5b6-4c70-b9b7-d65536de7a88 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:47.244111 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-af83d777-b5b6-4c70-b9b7-d65536de7a88 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:47.245528 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-af83d777-b5b6-4c70-b9b7-d65536de7a88 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:47.246865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-af83d777-b5b6-4c70-b9b7-d65536de7a88 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.203018 Nov 11 20:44:47.247639 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 620/1115] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:44:47 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:44:47.373661 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d56aa5fc-ea45-4861-ad1a-61eb7df02ac0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:47.374958 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d56aa5fc-ea45-4861-ad1a-61eb7df02ac0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:47.382260 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d56aa5fc-ea45-4861-ad1a-61eb7df02ac0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:47.382933 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d56aa5fc-ea45-4861-ad1a-61eb7df02ac0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:47.383726 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d56aa5fc-ea45-4861-ad1a-61eb7df02ac0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:47.384193 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d56aa5fc-ea45-4861-ad1a-61eb7df02ac0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:47.521372 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d56aa5fc-ea45-4861-ad1a-61eb7df02ac0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:47.529115 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d56aa5fc-ea45-4861-ad1a-61eb7df02ac0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.159565 Nov 11 20:44:47.529682 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 496/1116] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:47 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:48.267411 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-873b781b-0f91-4a5a-9805-872baf13cdb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:48.267411 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-873b781b-0f91-4a5a-9805-872baf13cdb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:48.277271 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-873b781b-0f91-4a5a-9805-872baf13cdb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:48.277672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-873b781b-0f91-4a5a-9805-872baf13cdb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:48.278543 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-873b781b-0f91-4a5a-9805-872baf13cdb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:48.279052 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-873b781b-0f91-4a5a-9805-872baf13cdb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:48.418388 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-873b781b-0f91-4a5a-9805-872baf13cdb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:48.427692 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-873b781b-0f91-4a5a-9805-872baf13cdb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:48.429222 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-873b781b-0f91-4a5a-9805-872baf13cdb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:48.430477 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-873b781b-0f91-4a5a-9805-872baf13cdb0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.168552 Nov 11 20:44:48.431034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 621/1117] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:44:48 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:44:48.767173 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-93c692b1-4f30-4db2-90ff-cdab22610844 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:48.767778 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-93c692b1-4f30-4db2-90ff-cdab22610844 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:48.773680 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-93c692b1-4f30-4db2-90ff-cdab22610844 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:48.774129 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-93c692b1-4f30-4db2-90ff-cdab22610844 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:48.774905 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-93c692b1-4f30-4db2-90ff-cdab22610844 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:48.775339 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-93c692b1-4f30-4db2-90ff-cdab22610844 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:48.912673 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-93c692b1-4f30-4db2-90ff-cdab22610844 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:48.919809 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-93c692b1-4f30-4db2-90ff-cdab22610844 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.376772 Nov 11 20:44:48.920664 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 497/1118] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:48 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:49.449633 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5c0f3e9f-2049-452f-9bea-4e31eb317499 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:49.450237 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5c0f3e9f-2049-452f-9bea-4e31eb317499 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:49.457539 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c0f3e9f-2049-452f-9bea-4e31eb317499 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:49.458573 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c0f3e9f-2049-452f-9bea-4e31eb317499 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:49.459629 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c0f3e9f-2049-452f-9bea-4e31eb317499 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:49.460420 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5c0f3e9f-2049-452f-9bea-4e31eb317499 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:49.602906 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5c0f3e9f-2049-452f-9bea-4e31eb317499 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:49.612172 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5c0f3e9f-2049-452f-9bea-4e31eb317499 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:49.613525 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5c0f3e9f-2049-452f-9bea-4e31eb317499 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:49.623279 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5c0f3e9f-2049-452f-9bea-4e31eb317499 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1723 microversion: 2.20 time: 0.168972 Nov 11 20:44:49.623279 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 622/1119] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:44:49 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:44:49.939953 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-90699374-9aea-49e3-aaf7-4ae1f04dc882 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:49.940589 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-90699374-9aea-49e3-aaf7-4ae1f04dc882 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:49.946952 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-90699374-9aea-49e3-aaf7-4ae1f04dc882 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:49.947401 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-90699374-9aea-49e3-aaf7-4ae1f04dc882 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:49.948240 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-90699374-9aea-49e3-aaf7-4ae1f04dc882 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:49.948675 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-90699374-9aea-49e3-aaf7-4ae1f04dc882 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:50.260039 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-90699374-9aea-49e3-aaf7-4ae1f04dc882 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:50.268026 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-90699374-9aea-49e3-aaf7-4ae1f04dc882 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.332603 Nov 11 20:44:50.268604 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 498/1120] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:49 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:50.633853 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-13911940-e4d2-441b-a915-e46841d2a449 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:50.634631 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-13911940-e4d2-441b-a915-e46841d2a449 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:50.642259 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13911940-e4d2-441b-a915-e46841d2a449 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:50.642705 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13911940-e4d2-441b-a915-e46841d2a449 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:50.643572 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13911940-e4d2-441b-a915-e46841d2a449 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:50.644037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13911940-e4d2-441b-a915-e46841d2a449 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:50.888712 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-13911940-e4d2-441b-a915-e46841d2a449 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:50.898840 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-13911940-e4d2-441b-a915-e46841d2a449 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:50.900635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-13911940-e4d2-441b-a915-e46841d2a449 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:50.901931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-13911940-e4d2-441b-a915-e46841d2a449 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1655 microversion: 2.20 time: 0.271843 Nov 11 20:44:50.902573 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 623/1121] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:44:50 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1655 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:44:51.005015 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-02e1b5de-8b9b-4508-a01a-5d3dd7669ff0 req-33c8b95f-319e-458b-a5ad-b500db090e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce4a9f51-80d0-4901-beaf-9b03435f002c", "name": "network-vif-deleted", "tag": "bc0e19f0-bdca-4923-a0c3-77ad0c202bdc"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:44:51.006702 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:44:51.006702 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:44:51.015995 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-02e1b5de-8b9b-4508-a01a-5d3dd7669ff0 req-33c8b95f-319e-458b-a5ad-b500db090e0b service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:51.016668 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-02e1b5de-8b9b-4508-a01a-5d3dd7669ff0 req-33c8b95f-319e-458b-a5ad-b500db090e0b service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:51.027642 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-02e1b5de-8b9b-4508-a01a-5d3dd7669ff0 req-33c8b95f-319e-458b-a5ad-b500db090e0b service nova] Creating event network-vif-deleted:bc0e19f0-bdca-4923-a0c3-77ad0c202bdc for instance ce4a9f51-80d0-4901-beaf-9b03435f002c on hv-cinder-81764 Nov 11 20:44:51.032518 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-02e1b5de-8b9b-4508-a01a-5d3dd7669ff0 req-33c8b95f-319e-458b-a5ad-b500db090e0b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031256 Nov 11 20:44:51.033106 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 499/1122] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:44:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:44:51.284065 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-05c8d748-2a06-4cf3-ae0d-b7795966d4f9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:51.284682 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-05c8d748-2a06-4cf3-ae0d-b7795966d4f9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:51.290888 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05c8d748-2a06-4cf3-ae0d-b7795966d4f9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:51.291340 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05c8d748-2a06-4cf3-ae0d-b7795966d4f9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:51.292163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05c8d748-2a06-4cf3-ae0d-b7795966d4f9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:51.292601 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05c8d748-2a06-4cf3-ae0d-b7795966d4f9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:51.431038 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-05c8d748-2a06-4cf3-ae0d-b7795966d4f9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:51.439870 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-05c8d748-2a06-4cf3-ae0d-b7795966d4f9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.159612 Nov 11 20:44:51.440495 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 624/1123] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:51 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:51.922900 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a7e7b3de-042d-43c2-ae67-bb37132e6a57 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:51.923604 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a7e7b3de-042d-43c2-ae67-bb37132e6a57 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:51.929917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a7e7b3de-042d-43c2-ae67-bb37132e6a57 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:51.930363 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a7e7b3de-042d-43c2-ae67-bb37132e6a57 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:51.931155 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a7e7b3de-042d-43c2-ae67-bb37132e6a57 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:51.931592 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a7e7b3de-042d-43c2-ae67-bb37132e6a57 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:51.996469 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a7e7b3de-042d-43c2-ae67-bb37132e6a57 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:52.007713 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a7e7b3de-042d-43c2-ae67-bb37132e6a57 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:52.009921 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a7e7b3de-042d-43c2-ae67-bb37132e6a57 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:52.011280 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a7e7b3de-042d-43c2-ae67-bb37132e6a57 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1366 microversion: 2.20 time: 0.093700 Nov 11 20:44:52.012800 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 500/1124] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:44:51 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:44:52.457343 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5b5c4ccf-07dd-4429-8a15-9417b087a967 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:52.458628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5b5c4ccf-07dd-4429-8a15-9417b087a967 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:52.465928 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b5c4ccf-07dd-4429-8a15-9417b087a967 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:52.466367 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b5c4ccf-07dd-4429-8a15-9417b087a967 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:52.467157 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b5c4ccf-07dd-4429-8a15-9417b087a967 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:52.467581 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b5c4ccf-07dd-4429-8a15-9417b087a967 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:52.596615 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5b5c4ccf-07dd-4429-8a15-9417b087a967 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:52.603845 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5b5c4ccf-07dd-4429-8a15-9417b087a967 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.150337 Nov 11 20:44:52.604447 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 625/1125] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:52 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:53.029757 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-41e9e33a-7664-4944-a2c7-0692ae9f246f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:53.030457 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-41e9e33a-7664-4944-a2c7-0692ae9f246f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:53.037389 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-41e9e33a-7664-4944-a2c7-0692ae9f246f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:53.037835 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-41e9e33a-7664-4944-a2c7-0692ae9f246f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:53.038615 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-41e9e33a-7664-4944-a2c7-0692ae9f246f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:53.039051 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-41e9e33a-7664-4944-a2c7-0692ae9f246f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:53.100889 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-41e9e33a-7664-4944-a2c7-0692ae9f246f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:53.109779 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-41e9e33a-7664-4944-a2c7-0692ae9f246f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:53.111439 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-41e9e33a-7664-4944-a2c7-0692ae9f246f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:53.112675 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-41e9e33a-7664-4944-a2c7-0692ae9f246f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 200 len: 1366 microversion: 2.20 time: 0.086577 Nov 11 20:44:53.113271 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 501/1126] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:44:53 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:44:53.621861 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b737282c-3cb2-4935-a882-cc76558f9b70 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:53.622667 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b737282c-3cb2-4935-a882-cc76558f9b70 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:53.630133 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b737282c-3cb2-4935-a882-cc76558f9b70 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:53.630802 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b737282c-3cb2-4935-a882-cc76558f9b70 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:53.631912 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b737282c-3cb2-4935-a882-cc76558f9b70 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:53.632393 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b737282c-3cb2-4935-a882-cc76558f9b70 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:53.779568 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b737282c-3cb2-4935-a882-cc76558f9b70 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:53.787959 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b737282c-3cb2-4935-a882-cc76558f9b70 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.170085 Nov 11 20:44:53.788549 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 626/1127] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:53 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:54.131707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7c216bf7-9281-4cca-b57f-b623423f7a80 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:54.132305 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7c216bf7-9281-4cca-b57f-b623423f7a80 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:54.138592 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7c216bf7-9281-4cca-b57f-b623423f7a80 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:54.139466 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7c216bf7-9281-4cca-b57f-b623423f7a80 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:54.139838 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7c216bf7-9281-4cca-b57f-b623423f7a80 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:54.142546 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7c216bf7-9281-4cca-b57f-b623423f7a80 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:54.156572 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-7c216bf7-9281-4cca-b57f-b623423f7a80 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] HTTP exception thrown: Instance ce4a9f51-80d0-4901-beaf-9b03435f002c could not be found. Nov 11 20:44:54.157212 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7c216bf7-9281-4cca-b57f-b623423f7a80 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Returning 404 to user: Instance ce4a9f51-80d0-4901-beaf-9b03435f002c could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:44:54.158045 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7c216bf7-9281-4cca-b57f-b623423f7a80 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 404 len: 111 microversion: 2.20 time: 0.030231 Nov 11 20:44:54.158789 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 502/1128] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:44:54 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 11 20:44:54.167073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cc970873-c594-4d41-8bed-cfd46b83cd48 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '.version_select at 0x7ff3f2a82430>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:54.185260 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cc970873-c594-4d41-8bed-cfd46b83cd48 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-288013805" status: 204 len: 0 microversion: 2.20 time: 0.021927 Nov 11 20:44:54.185822 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 627/1129] 10.222.0.61 () {60 vars in 1258 bytes} [Thu Nov 11 20:44:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-288013805 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 11 20:44:54.804910 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-19757e2b-770d-4bde-90e7-e88aba584dcb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:54.805529 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-19757e2b-770d-4bde-90e7-e88aba584dcb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:54.811428 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-19757e2b-770d-4bde-90e7-e88aba584dcb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:54.811952 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-19757e2b-770d-4bde-90e7-e88aba584dcb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:54.812758 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-19757e2b-770d-4bde-90e7-e88aba584dcb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:54.813197 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-19757e2b-770d-4bde-90e7-e88aba584dcb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:54.845399 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ca1a6a82-31ff-44c9-8ccc-e79260aecc6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'create', calling method: .version_select at 0x7ff3f29ce8b0>, body: {"keypair": {"name": "tempest-keypair-900921978"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:44:54.860824 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-ca1a6a82-31ff-44c9-8ccc-e79260aecc6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Getting quotas for project 38d540a76ef9405bb94b7e433494fabd. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:44:54.864739 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-ca1a6a82-31ff-44c9-8ccc-e79260aecc6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Getting quotas for user c3e90865af2147c995fb58e24129d032 and project 38d540a76ef9405bb94b7e433494fabd. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:44:54.953388 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-19757e2b-770d-4bde-90e7-e88aba584dcb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:54.960987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-19757e2b-770d-4bde-90e7-e88aba584dcb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.159745 Nov 11 20:44:54.970430 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 503/1130] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:54 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:55.133043 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-ca1a6a82-31ff-44c9-8ccc-e79260aecc6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Getting quotas for project 38d540a76ef9405bb94b7e433494fabd. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:44:55.136718 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-ca1a6a82-31ff-44c9-8ccc-e79260aecc6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Getting quotas for user c3e90865af2147c995fb58e24129d032 and project 38d540a76ef9405bb94b7e433494fabd. Resources: {'key_pairs'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:44:55.150831 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ca1a6a82-31ff-44c9-8ccc-e79260aecc6a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.310405 Nov 11 20:44:55.151441 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 628/1131] 10.222.0.61 () {62 vars in 1198 bytes} [Thu Nov 11 20:44:54 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 312 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 11 20:44:55.978358 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b8111663-4d20-49d4-a307-857d3b21812b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:55.978953 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b8111663-4d20-49d4-a307-857d3b21812b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:55.986020 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b8111663-4d20-49d4-a307-857d3b21812b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:55.986463 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b8111663-4d20-49d4-a307-857d3b21812b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:55.987239 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b8111663-4d20-49d4-a307-857d3b21812b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:55.987670 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b8111663-4d20-49d4-a307-857d3b21812b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:56.130377 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b8111663-4d20-49d4-a307-857d3b21812b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:56.138543 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b8111663-4d20-49d4-a307-857d3b21812b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.163647 Nov 11 20:44:56.139135 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 504/1132] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:55 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:56.454398 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1454666278", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51d362a5-52f5-4926-aac3-68c4c9326236"}], "security_groups": [{"name": "tempest-securitygroup--1053782201"}], "key_name": "tempest-keypair-900921978", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:44:56.558629 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.network.neutron [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] validate_networks() for [('51d362a5-52f5-4926-aac3-68c4c9326236', None, None, None, None, None)] {{(pid=122526) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:44:57.027178 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Flavor limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:44:57.027595 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Image limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:44:57.028120 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Flavor pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:44:57.028529 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Image pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:44:57.028939 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:44:57.043273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:57.043273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:57.043273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:57.043273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:57.057053 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Getting quotas for project 38d540a76ef9405bb94b7e433494fabd. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:44:57.060916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Getting quotas for user c3e90865af2147c995fb58e24129d032 and project 38d540a76ef9405bb94b7e433494fabd. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:44:57.072059 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Going to run 1 instances... {{(pid=122526) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:44:57.074367 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:44:57.120338 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1036f08f-e8fe-486f-8a34-2e03331a83da tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.670656 Nov 11 20:44:57.121283 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 629/1133] 10.222.0.61 () {62 vars in 1187 bytes} [Thu Nov 11 20:44:56 2021] POST /compute/v2.1/servers => generated 402 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 11 20:44:57.132719 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ae51a9bf-f202-492a-bd8d-cd51662d2948 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:57.133350 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ae51a9bf-f202-492a-bd8d-cd51662d2948 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:57.156104 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f09e5fb3-5853-4788-a4db-23270e13ac4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:57.156711 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f09e5fb3-5853-4788-a4db-23270e13ac4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:57.162855 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f09e5fb3-5853-4788-a4db-23270e13ac4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:57.163292 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f09e5fb3-5853-4788-a4db-23270e13ac4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:57.164271 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f09e5fb3-5853-4788-a4db-23270e13ac4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:57.164531 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f09e5fb3-5853-4788-a4db-23270e13ac4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:57.190877 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ae51a9bf-f202-492a-bd8d-cd51662d2948 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:57.199475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ae51a9bf-f202-492a-bd8d-cd51662d2948 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:57.201109 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ae51a9bf-f202-492a-bd8d-cd51662d2948 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:57.202502 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ae51a9bf-f202-492a-bd8d-cd51662d2948 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1281 microversion: 2.20 time: 0.074047 Nov 11 20:44:57.203540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 505/1134] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:44:57 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:44:57.317357 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f09e5fb3-5853-4788-a4db-23270e13ac4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:57.326795 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f09e5fb3-5853-4788-a4db-23270e13ac4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.174679 Nov 11 20:44:57.327410 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 630/1135] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:57 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:58.221774 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-809b1b84-6ac2-4958-a814-266ac3e3691c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:58.222966 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-809b1b84-6ac2-4958-a814-266ac3e3691c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:58.230045 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-809b1b84-6ac2-4958-a814-266ac3e3691c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:58.230486 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-809b1b84-6ac2-4958-a814-266ac3e3691c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:58.231257 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-809b1b84-6ac2-4958-a814-266ac3e3691c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:58.231685 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-809b1b84-6ac2-4958-a814-266ac3e3691c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:58.299938 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-809b1b84-6ac2-4958-a814-266ac3e3691c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:58.308021 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-809b1b84-6ac2-4958-a814-266ac3e3691c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:58.309797 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-809b1b84-6ac2-4958-a814-266ac3e3691c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:58.310909 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-809b1b84-6ac2-4958-a814-266ac3e3691c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1333 microversion: 2.20 time: 0.093238 Nov 11 20:44:58.311482 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 506/1136] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:44:58 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:44:58.344099 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b70d5ec1-e35c-4de6-8173-479d1bd08e87 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:58.344732 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b70d5ec1-e35c-4de6-8173-479d1bd08e87 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:58.351426 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b70d5ec1-e35c-4de6-8173-479d1bd08e87 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:58.351876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b70d5ec1-e35c-4de6-8173-479d1bd08e87 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:58.352772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b70d5ec1-e35c-4de6-8173-479d1bd08e87 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:58.353153 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b70d5ec1-e35c-4de6-8173-479d1bd08e87 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:58.616814 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-451787760", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1324740347", "security_groups": [{"name": "tempest-secgroup-smoke-1604159381"}], "networks": [{"uuid": "86e64690-2a5a-4e0a-b625-102ea78f3628"}], "block_device_mapping_v2": [{"uuid": "c5b40928-fa61-430e-b2ab-98d6f9aa5076", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:44:58.622462 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b70d5ec1-e35c-4de6-8173-479d1bd08e87 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:58.630998 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b70d5ec1-e35c-4de6-8173-479d1bd08e87 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.290725 Nov 11 20:44:58.631594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 631/1137] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:58 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:44:58.805601 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.network.neutron [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] validate_networks() for [('86e64690-2a5a-4e0a-b625-102ea78f3628', None, None, None, None, None)] {{(pid=122527) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:44:59.331092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f0631c25-0c94-4e25-bae1-64aa7cc598eb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:59.331693 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f0631c25-0c94-4e25-bae1-64aa7cc598eb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:59.338332 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f0631c25-0c94-4e25-bae1-64aa7cc598eb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:59.338779 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f0631c25-0c94-4e25-bae1-64aa7cc598eb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:59.339567 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f0631c25-0c94-4e25-bae1-64aa7cc598eb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:59.340028 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f0631c25-0c94-4e25-bae1-64aa7cc598eb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:59.415589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f0631c25-0c94-4e25-bae1-64aa7cc598eb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:59.424362 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f0631c25-0c94-4e25-bae1-64aa7cc598eb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:59.425886 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f0631c25-0c94-4e25-bae1-64aa7cc598eb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:59.426979 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f0631c25-0c94-4e25-bae1-64aa7cc598eb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1339 microversion: 2.20 time: 0.100453 Nov 11 20:44:59.427754 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 632/1138] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:44:59 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:44:59.490691 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Flavor limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:44:59.491160 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Image limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:44:59.492314 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Flavor pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:44:59.492734 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Image pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:44:59.493345 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:44:59.505097 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:59.505097 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:59.505400 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:59.505632 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:59.533947 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Getting quotas for project 1ad6c752ea6048068ad66bddb0f2968f. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:44:59.539428 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Getting quotas for user f04ea153f3a44236a3cc29bb26dcacbd and project 1ad6c752ea6048068ad66bddb0f2968f. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:44:59.618066 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Going to run 1 instances... {{(pid=122527) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:44:59.621612 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5b40928-fa61-430e-b2ab-98d6f9aa5076',volume_size=None,volume_type=None)] {{(pid=122527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:44:59.650211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-225310b7-d3ac-4a35-b84c-6796091f80f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:59.651197 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-225310b7-d3ac-4a35-b84c-6796091f80f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:59.659469 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-225310b7-d3ac-4a35-b84c-6796091f80f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:59.660291 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-225310b7-d3ac-4a35-b84c-6796091f80f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:59.661901 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-225310b7-d3ac-4a35-b84c-6796091f80f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:44:59.662562 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-225310b7-d3ac-4a35-b84c-6796091f80f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:44:59.805689 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e511b2eb-75e2-42b6-aab3-b74c55b10bbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.192916 Nov 11 20:44:59.806331 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 507/1139] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:44:58 2021] POST /compute/v2.1/servers => generated 406 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 11 20:44:59.817596 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d6674ca6-d08d-488e-bf68-2ca7f18caee1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:44:59.819095 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d6674ca6-d08d-488e-bf68-2ca7f18caee1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:44:59.946377 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d6674ca6-d08d-488e-bf68-2ca7f18caee1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:44:59.955322 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d6674ca6-d08d-488e-bf68-2ca7f18caee1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1088 microversion: 2.1 time: 0.141877 Nov 11 20:44:59.956244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 508/1140] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:59 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1088 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:45:00.001068 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-225310b7-d3ac-4a35-b84c-6796091f80f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:00.008756 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-225310b7-d3ac-4a35-b84c-6796091f80f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.363968 Nov 11 20:45:00.009896 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 633/1141] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:44:59 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:45:00.451807 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c8f3f59f-a032-4e3d-b0b1-d197f0ca221d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:00.453577 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c8f3f59f-a032-4e3d-b0b1-d197f0ca221d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:00.473591 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c8f3f59f-a032-4e3d-b0b1-d197f0ca221d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:00.475839 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c8f3f59f-a032-4e3d-b0b1-d197f0ca221d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:00.477753 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c8f3f59f-a032-4e3d-b0b1-d197f0ca221d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:00.478887 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c8f3f59f-a032-4e3d-b0b1-d197f0ca221d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:00.524321 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-150b8776-352a-47f8-8543-f4afb4a922bf req-948c06bf-db8e-47bf-a2c8-608038b17b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e", "tag": "962e998a-c58f-4876-b93f-8de3af37c538"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:00.536938 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:45:00.536938 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:45:00.548224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-150b8776-352a-47f8-8543-f4afb4a922bf req-948c06bf-db8e-47bf-a2c8-608038b17b2d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:00.549134 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-150b8776-352a-47f8-8543-f4afb4a922bf req-948c06bf-db8e-47bf-a2c8-608038b17b2d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:00.586690 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-150b8776-352a-47f8-8543-f4afb4a922bf req-948c06bf-db8e-47bf-a2c8-608038b17b2d service nova] Creating event network-changed:962e998a-c58f-4876-b93f-8de3af37c538 for instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e on hv-cinder-81764 Nov 11 20:45:00.604887 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-150b8776-352a-47f8-8543-f4afb4a922bf req-948c06bf-db8e-47bf-a2c8-608038b17b2d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107603 Nov 11 20:45:00.607136 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 634/1142] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:45:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:45:00.733497 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c8f3f59f-a032-4e3d-b0b1-d197f0ca221d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:00.746740 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c8f3f59f-a032-4e3d-b0b1-d197f0ca221d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:00.753455 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c8f3f59f-a032-4e3d-b0b1-d197f0ca221d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:00.758619 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c8f3f59f-a032-4e3d-b0b1-d197f0ca221d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1407 microversion: 2.20 time: 0.317444 Nov 11 20:45:00.759376 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 509/1143] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:45:00 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:45:00.973132 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4fcd8c56-a224-403a-9220-610409994963 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:00.973903 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4fcd8c56-a224-403a-9220-610409994963 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:00.980762 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4fcd8c56-a224-403a-9220-610409994963 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:00.981468 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4fcd8c56-a224-403a-9220-610409994963 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:00.982310 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4fcd8c56-a224-403a-9220-610409994963 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:00.982807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4fcd8c56-a224-403a-9220-610409994963 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:01.028142 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f9a155f0-d85d-44ef-9b99-420b167f192a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:01.028698 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f9a155f0-d85d-44ef-9b99-420b167f192a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:01.035374 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f9a155f0-d85d-44ef-9b99-420b167f192a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:01.036233 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f9a155f0-d85d-44ef-9b99-420b167f192a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:01.037240 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f9a155f0-d85d-44ef-9b99-420b167f192a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:01.037838 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f9a155f0-d85d-44ef-9b99-420b167f192a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:01.063709 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4fcd8c56-a224-403a-9220-610409994963 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:01.071512 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4fcd8c56-a224-403a-9220-610409994963 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1186 microversion: 2.1 time: 0.102469 Nov 11 20:45:01.078618 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 635/1144] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:00 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:01.331593 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f9a155f0-d85d-44ef-9b99-420b167f192a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:01.339945 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f9a155f0-d85d-44ef-9b99-420b167f192a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.315913 Nov 11 20:45:01.340741 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 510/1145] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:01 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:01.777801 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b1c8f8d4-2292-4a3b-91b1-b5697fe08b4e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:01.778409 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b1c8f8d4-2292-4a3b-91b1-b5697fe08b4e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:01.785400 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b1c8f8d4-2292-4a3b-91b1-b5697fe08b4e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:01.786086 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b1c8f8d4-2292-4a3b-91b1-b5697fe08b4e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:01.787055 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b1c8f8d4-2292-4a3b-91b1-b5697fe08b4e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:01.787493 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b1c8f8d4-2292-4a3b-91b1-b5697fe08b4e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:02.089507 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8d0fec7f-0533-4005-961e-d1f75e2b2b19 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:02.090883 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8d0fec7f-0533-4005-961e-d1f75e2b2b19 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:02.098081 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8d0fec7f-0533-4005-961e-d1f75e2b2b19 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:02.098911 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8d0fec7f-0533-4005-961e-d1f75e2b2b19 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:02.099706 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8d0fec7f-0533-4005-961e-d1f75e2b2b19 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:02.100170 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8d0fec7f-0533-4005-961e-d1f75e2b2b19 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:02.120750 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b1c8f8d4-2292-4a3b-91b1-b5697fe08b4e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:02.132477 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b1c8f8d4-2292-4a3b-91b1-b5697fe08b4e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:02.133971 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b1c8f8d4-2292-4a3b-91b1-b5697fe08b4e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:02.135079 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b1c8f8d4-2292-4a3b-91b1-b5697fe08b4e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1407 microversion: 2.20 time: 0.361038 Nov 11 20:45:02.135636 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 636/1146] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:45:01 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:45:02.196842 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-8d0fec7f-0533-4005-961e-d1f75e2b2b19 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:02.205055 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8d0fec7f-0533-4005-961e-d1f75e2b2b19 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1204 microversion: 2.1 time: 0.119686 Nov 11 20:45:02.205629 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 511/1147] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:02 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1204 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:45:02.358499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c3f59493-83a7-44a4-b0ca-a25d0b800fa1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:02.359192 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c3f59493-83a7-44a4-b0ca-a25d0b800fa1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:02.365275 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c3f59493-83a7-44a4-b0ca-a25d0b800fa1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:02.365730 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c3f59493-83a7-44a4-b0ca-a25d0b800fa1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:02.366520 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c3f59493-83a7-44a4-b0ca-a25d0b800fa1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:02.366979 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c3f59493-83a7-44a4-b0ca-a25d0b800fa1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:02.637228 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c3f59493-83a7-44a4-b0ca-a25d0b800fa1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:02.645071 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c3f59493-83a7-44a4-b0ca-a25d0b800fa1 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1676 microversion: 2.1 time: 0.290359 Nov 11 20:45:02.645653 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 637/1148] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:02 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1676 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:03.157631 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7bfe3a6d-9943-418e-aa9f-b778ae3438e5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:03.158273 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7bfe3a6d-9943-418e-aa9f-b778ae3438e5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:03.165183 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7bfe3a6d-9943-418e-aa9f-b778ae3438e5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:03.165666 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7bfe3a6d-9943-418e-aa9f-b778ae3438e5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:03.166564 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7bfe3a6d-9943-418e-aa9f-b778ae3438e5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:03.167023 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7bfe3a6d-9943-418e-aa9f-b778ae3438e5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:03.223503 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a63689d7-6a18-460d-81ff-acdc4dc451e1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:03.225021 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a63689d7-6a18-460d-81ff-acdc4dc451e1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:03.230995 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a63689d7-6a18-460d-81ff-acdc4dc451e1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:03.231924 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a63689d7-6a18-460d-81ff-acdc4dc451e1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:03.233396 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a63689d7-6a18-460d-81ff-acdc4dc451e1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:03.234849 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a63689d7-6a18-460d-81ff-acdc4dc451e1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:03.508977 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7bfe3a6d-9943-418e-aa9f-b778ae3438e5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:03.519266 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7bfe3a6d-9943-418e-aa9f-b778ae3438e5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:03.520793 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7bfe3a6d-9943-418e-aa9f-b778ae3438e5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:03.521969 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7bfe3a6d-9943-418e-aa9f-b778ae3438e5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1407 microversion: 2.20 time: 0.370231 Nov 11 20:45:03.522750 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 512/1149] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:45:03 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:45:03.548219 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a63689d7-6a18-460d-81ff-acdc4dc451e1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:03.555826 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a63689d7-6a18-460d-81ff-acdc4dc451e1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1260 microversion: 2.1 time: 0.336857 Nov 11 20:45:03.556516 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 638/1150] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:03 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1260 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:45:03.631854 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-b950b278-150c-4a14-a2db-0a109bc201c1 req-61293779-8e2c-4db1-90f7-8496833abe03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a4baaf-615d-4da4-b61e-5a9199179627", "tag": "40bfc231-ecda-4dd7-a914-d4fd0a2d487b"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:03.634532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:45:03.634532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:45:03.644616 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-b950b278-150c-4a14-a2db-0a109bc201c1 req-61293779-8e2c-4db1-90f7-8496833abe03 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:03.645104 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-b950b278-150c-4a14-a2db-0a109bc201c1 req-61293779-8e2c-4db1-90f7-8496833abe03 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:03.663225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-11877676-5b1e-4f9b-97cc-6602fe189dd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:03.663836 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-11877676-5b1e-4f9b-97cc-6602fe189dd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:03.667167 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-b950b278-150c-4a14-a2db-0a109bc201c1 req-61293779-8e2c-4db1-90f7-8496833abe03 service nova] Creating event network-changed:40bfc231-ecda-4dd7-a914-d4fd0a2d487b for instance c9a4baaf-615d-4da4-b61e-5a9199179627 on hv-cinder-81764 Nov 11 20:45:03.670175 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11877676-5b1e-4f9b-97cc-6602fe189dd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:03.670839 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11877676-5b1e-4f9b-97cc-6602fe189dd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:03.672730 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11877676-5b1e-4f9b-97cc-6602fe189dd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:03.672958 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-b950b278-150c-4a14-a2db-0a109bc201c1 req-61293779-8e2c-4db1-90f7-8496833abe03 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044971 Nov 11 20:45:03.673521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11877676-5b1e-4f9b-97cc-6602fe189dd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:03.674175 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 513/1151] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:45:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:45:03.897139 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-11877676-5b1e-4f9b-97cc-6602fe189dd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:03.904773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-11877676-5b1e-4f9b-97cc-6602fe189dd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1653 microversion: 2.1 time: 0.245373 Nov 11 20:45:03.905369 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 639/1152] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:03 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1653 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:45:03.922298 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-bc05060e-69fd-4771-8427-9dd739490bcd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:03.928733 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bc05060e-69fd-4771-8427-9dd739490bcd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:03.929208 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bc05060e-69fd-4771-8427-9dd739490bcd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:03.953274 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-bc05060e-69fd-4771-8427-9dd739490bcd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Going to try to start instance {{(pid=122527) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 11 20:45:04.010203 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-bc05060e-69fd-4771-8427-9dd739490bcd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action" status: 202 len: 0 microversion: 2.1 time: 0.092205 Nov 11 20:45:04.010863 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 514/1153] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:45:03 2021] POST /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:45:04.021461 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d30e2f44-b0f8-4e08-874a-11d32c9f0dc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:04.022268 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d30e2f44-b0f8-4e08-874a-11d32c9f0dc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:04.030033 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d30e2f44-b0f8-4e08-874a-11d32c9f0dc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:04.030680 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d30e2f44-b0f8-4e08-874a-11d32c9f0dc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:04.031905 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d30e2f44-b0f8-4e08-874a-11d32c9f0dc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:04.032407 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d30e2f44-b0f8-4e08-874a-11d32c9f0dc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:04.321672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d30e2f44-b0f8-4e08-874a-11d32c9f0dc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:04.330027 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d30e2f44-b0f8-4e08-874a-11d32c9f0dc0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1662 microversion: 2.1 time: 0.314452 Nov 11 20:45:04.330612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 640/1154] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:04 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1662 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:45:04.543508 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-05f81651-41a0-4c92-bec3-bf6b55ecbd74 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:04.544894 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-05f81651-41a0-4c92-bec3-bf6b55ecbd74 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:04.551740 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-05f81651-41a0-4c92-bec3-bf6b55ecbd74 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:04.552545 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-05f81651-41a0-4c92-bec3-bf6b55ecbd74 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:04.553992 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-05f81651-41a0-4c92-bec3-bf6b55ecbd74 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:04.554432 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-05f81651-41a0-4c92-bec3-bf6b55ecbd74 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:04.574134 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d6b647f6-856d-4d9a-9b00-1c901281bbd8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:04.575011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d6b647f6-856d-4d9a-9b00-1c901281bbd8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:04.582469 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d6b647f6-856d-4d9a-9b00-1c901281bbd8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:04.582906 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d6b647f6-856d-4d9a-9b00-1c901281bbd8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:04.583687 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d6b647f6-856d-4d9a-9b00-1c901281bbd8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:04.584309 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d6b647f6-856d-4d9a-9b00-1c901281bbd8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:05.068706 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d6b647f6-856d-4d9a-9b00-1c901281bbd8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:05.075916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d6b647f6-856d-4d9a-9b00-1c901281bbd8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1260 microversion: 2.1 time: 0.505391 Nov 11 20:45:05.076535 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 641/1155] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:04 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1260 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:05.088897 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-05f81651-41a0-4c92-bec3-bf6b55ecbd74 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:05.099585 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-05f81651-41a0-4c92-bec3-bf6b55ecbd74 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:05.101312 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-05f81651-41a0-4c92-bec3-bf6b55ecbd74 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:05.102499 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-05f81651-41a0-4c92-bec3-bf6b55ecbd74 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1407 microversion: 2.20 time: 0.563354 Nov 11 20:45:05.103238 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 515/1156] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:45:04 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1407 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:45:05.349920 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-811d3b48-c15f-4b83-a765-a04de22f000d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:05.351287 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-811d3b48-c15f-4b83-a765-a04de22f000d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:05.360613 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-811d3b48-c15f-4b83-a765-a04de22f000d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:05.361277 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-811d3b48-c15f-4b83-a765-a04de22f000d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:05.362437 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-811d3b48-c15f-4b83-a765-a04de22f000d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:05.363208 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-811d3b48-c15f-4b83-a765-a04de22f000d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:05.762358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-811d3b48-c15f-4b83-a765-a04de22f000d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:05.770266 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-811d3b48-c15f-4b83-a765-a04de22f000d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1662 microversion: 2.1 time: 0.424751 Nov 11 20:45:05.770868 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 642/1157] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:05 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1662 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:45:06.094178 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b2393c93-54d6-45ae-a6d3-0bf3b2653be8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:06.094913 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b2393c93-54d6-45ae-a6d3-0bf3b2653be8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:06.100987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2393c93-54d6-45ae-a6d3-0bf3b2653be8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:06.101428 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2393c93-54d6-45ae-a6d3-0bf3b2653be8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:06.102205 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2393c93-54d6-45ae-a6d3-0bf3b2653be8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:06.102634 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b2393c93-54d6-45ae-a6d3-0bf3b2653be8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:06.126078 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-194a7fd3-c2b7-4ffe-8458-6acafd861e14 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:06.127743 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-194a7fd3-c2b7-4ffe-8458-6acafd861e14 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:06.134336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-194a7fd3-c2b7-4ffe-8458-6acafd861e14 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:06.135153 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-194a7fd3-c2b7-4ffe-8458-6acafd861e14 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:06.136037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-194a7fd3-c2b7-4ffe-8458-6acafd861e14 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:06.136546 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-194a7fd3-c2b7-4ffe-8458-6acafd861e14 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:06.335216 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-194a7fd3-c2b7-4ffe-8458-6acafd861e14 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:06.336322 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b2393c93-54d6-45ae-a6d3-0bf3b2653be8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:06.351311 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b2393c93-54d6-45ae-a6d3-0bf3b2653be8 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1260 microversion: 2.1 time: 0.261922 Nov 11 20:45:06.351815 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 516/1158] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:06 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:06.352404 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-194a7fd3-c2b7-4ffe-8458-6acafd861e14 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:06.354594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-194a7fd3-c2b7-4ffe-8458-6acafd861e14 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:06.355938 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-194a7fd3-c2b7-4ffe-8458-6acafd861e14 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1407 microversion: 2.20 time: 0.235190 Nov 11 20:45:06.356727 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 643/1159] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:45:06 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:45:06.550977 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-a5e50986-b851-4606-8cf8-c385e1194ce9 req-6b121412-1943-46b0-af25-7f380000cbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e", "name": "network-vif-plugged", "status": "completed", "tag": "962e998a-c58f-4876-b93f-8de3af37c538"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:06.552547 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:45:06.552547 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:45:06.559225 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-a5e50986-b851-4606-8cf8-c385e1194ce9 req-6b121412-1943-46b0-af25-7f380000cbd6 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:06.559667 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-a5e50986-b851-4606-8cf8-c385e1194ce9 req-6b121412-1943-46b0-af25-7f380000cbd6 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:06.570926 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-a5e50986-b851-4606-8cf8-c385e1194ce9 req-6b121412-1943-46b0-af25-7f380000cbd6 service nova] Creating event network-vif-plugged:962e998a-c58f-4876-b93f-8de3af37c538 for instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e on hv-cinder-81764 Nov 11 20:45:06.575684 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-a5e50986-b851-4606-8cf8-c385e1194ce9 req-6b121412-1943-46b0-af25-7f380000cbd6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208512 Nov 11 20:45:06.576446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 517/1160] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:45:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:45:06.787165 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cb6eb756-381a-4fa4-92f4-72fa0251cb78 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:06.787783 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cb6eb756-381a-4fa4-92f4-72fa0251cb78 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:06.794126 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb6eb756-381a-4fa4-92f4-72fa0251cb78 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:06.794580 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb6eb756-381a-4fa4-92f4-72fa0251cb78 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:06.795369 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb6eb756-381a-4fa4-92f4-72fa0251cb78 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:06.795807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb6eb756-381a-4fa4-92f4-72fa0251cb78 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:06.926033 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cb6eb756-381a-4fa4-92f4-72fa0251cb78 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:06.933574 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cb6eb756-381a-4fa4-92f4-72fa0251cb78 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1666 microversion: 2.1 time: 0.150229 Nov 11 20:45:06.934144 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 644/1161] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:06 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:45:07.369677 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-92f18e39-2132-421d-88d1-7abf05b3c24d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:07.370367 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-92f18e39-2132-421d-88d1-7abf05b3c24d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:07.374888 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9cd4feec-2f54-4472-8fc7-fc892d35dfe4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:07.376257 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9cd4feec-2f54-4472-8fc7-fc892d35dfe4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:07.377438 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-92f18e39-2132-421d-88d1-7abf05b3c24d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:07.377884 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-92f18e39-2132-421d-88d1-7abf05b3c24d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:07.378656 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-92f18e39-2132-421d-88d1-7abf05b3c24d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:07.379088 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-92f18e39-2132-421d-88d1-7abf05b3c24d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:07.381980 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9cd4feec-2f54-4472-8fc7-fc892d35dfe4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:07.382425 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9cd4feec-2f54-4472-8fc7-fc892d35dfe4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:07.383201 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9cd4feec-2f54-4472-8fc7-fc892d35dfe4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:07.383633 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9cd4feec-2f54-4472-8fc7-fc892d35dfe4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:07.572129 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-92f18e39-2132-421d-88d1-7abf05b3c24d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:07.580148 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-92f18e39-2132-421d-88d1-7abf05b3c24d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1260 microversion: 2.1 time: 0.214433 Nov 11 20:45:07.580459 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9cd4feec-2f54-4472-8fc7-fc892d35dfe4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:07.580873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 518/1162] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:07 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:07.589389 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9cd4feec-2f54-4472-8fc7-fc892d35dfe4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:07.590893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9cd4feec-2f54-4472-8fc7-fc892d35dfe4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:07.592005 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9cd4feec-2f54-4472-8fc7-fc892d35dfe4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1407 microversion: 2.20 time: 0.221409 Nov 11 20:45:07.592560 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 645/1163] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:45:07 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:45:08.597761 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e509bf96-eb4a-4c2a-a7d0-8b40381ca798 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:08.598375 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e509bf96-eb4a-4c2a-a7d0-8b40381ca798 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:08.604678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e509bf96-eb4a-4c2a-a7d0-8b40381ca798 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:08.605133 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e509bf96-eb4a-4c2a-a7d0-8b40381ca798 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:08.605917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e509bf96-eb4a-4c2a-a7d0-8b40381ca798 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:08.606353 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e509bf96-eb4a-4c2a-a7d0-8b40381ca798 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:08.609523 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4eaec29d-7943-4557-87b0-55dac3cf02e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:08.610077 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4eaec29d-7943-4557-87b0-55dac3cf02e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:08.616348 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4eaec29d-7943-4557-87b0-55dac3cf02e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:08.616797 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4eaec29d-7943-4557-87b0-55dac3cf02e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:08.617585 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4eaec29d-7943-4557-87b0-55dac3cf02e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:08.618017 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4eaec29d-7943-4557-87b0-55dac3cf02e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:08.813025 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e509bf96-eb4a-4c2a-a7d0-8b40381ca798 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:08.817329 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4eaec29d-7943-4557-87b0-55dac3cf02e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:08.820571 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e509bf96-eb4a-4c2a-a7d0-8b40381ca798 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1260 microversion: 2.1 time: 0.227232 Nov 11 20:45:08.821147 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 519/1164] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:08 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:45:08.825391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4eaec29d-7943-4557-87b0-55dac3cf02e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:08.826973 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-4eaec29d-7943-4557-87b0-55dac3cf02e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:08.828878 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4eaec29d-7943-4557-87b0-55dac3cf02e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1598 microversion: 2.20 time: 0.223781 Nov 11 20:45:08.829530 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 646/1165] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:45:08 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1598 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:45:08.846645 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9ba95eb9-23d1-47ae-ba81-2d30a50b25c7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:08.847129 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9ba95eb9-23d1-47ae-ba81-2d30a50b25c7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:08.852983 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9ba95eb9-23d1-47ae-ba81-2d30a50b25c7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:08.853369 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9ba95eb9-23d1-47ae-ba81-2d30a50b25c7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:08.854147 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9ba95eb9-23d1-47ae-ba81-2d30a50b25c7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:08.854578 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9ba95eb9-23d1-47ae-ba81-2d30a50b25c7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:08.936212 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9ba95eb9-23d1-47ae-ba81-2d30a50b25c7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093612 Nov 11 20:45:08.937440 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 520/1166] 10.222.0.61 () {60 vars in 1315 bytes} [Thu Nov 11 20:45:08 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:45:09.838688 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7b847adb-07f1-49f0-bd88-1f34407dd32a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:09.839760 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7b847adb-07f1-49f0-bd88-1f34407dd32a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:09.847761 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7b847adb-07f1-49f0-bd88-1f34407dd32a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:09.848242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7b847adb-07f1-49f0-bd88-1f34407dd32a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:09.849036 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7b847adb-07f1-49f0-bd88-1f34407dd32a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:09.849471 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7b847adb-07f1-49f0-bd88-1f34407dd32a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:09.928329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8a82f6ec-f3ec-405b-9450-9e6b773aff61 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:09.929491 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8a82f6ec-f3ec-405b-9450-9e6b773aff61 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:09.936259 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8a82f6ec-f3ec-405b-9450-9e6b773aff61 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:09.936795 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8a82f6ec-f3ec-405b-9450-9e6b773aff61 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:09.938591 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8a82f6ec-f3ec-405b-9450-9e6b773aff61 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:09.938591 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8a82f6ec-f3ec-405b-9450-9e6b773aff61 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:10.010100 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7b847adb-07f1-49f0-bd88-1f34407dd32a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:10.016570 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8a82f6ec-f3ec-405b-9450-9e6b773aff61 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.092256 Nov 11 20:45:10.020037 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 521/1167] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:09 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:45:10.020193 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7b847adb-07f1-49f0-bd88-1f34407dd32a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1260 microversion: 2.1 time: 0.183705 Nov 11 20:45:10.020193 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 647/1168] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:09 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:10.022248 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-de006c7e-8eb9-443d-a1ac-5cebc4469208 req-29dd172d-f24b-40e1-85c4-8d00675a43b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e", "tag": "962e998a-c58f-4876-b93f-8de3af37c538"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:10.024306 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:45:10.024306 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:45:10.032930 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-de006c7e-8eb9-443d-a1ac-5cebc4469208 req-29dd172d-f24b-40e1-85c4-8d00675a43b2 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:10.033373 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-de006c7e-8eb9-443d-a1ac-5cebc4469208 req-29dd172d-f24b-40e1-85c4-8d00675a43b2 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:10.044704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-de006c7e-8eb9-443d-a1ac-5cebc4469208 req-29dd172d-f24b-40e1-85c4-8d00675a43b2 service nova] Creating event network-changed:962e998a-c58f-4876-b93f-8de3af37c538 for instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e on hv-cinder-81764 Nov 11 20:45:10.049969 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-de006c7e-8eb9-443d-a1ac-5cebc4469208 req-29dd172d-f24b-40e1-85c4-8d00675a43b2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031421 Nov 11 20:45:10.050603 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 522/1169] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:45:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:45:11.026820 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-67033229-7763-4960-aead-52351d4ca31e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:11.027822 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-67033229-7763-4960-aead-52351d4ca31e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:11.037167 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-67033229-7763-4960-aead-52351d4ca31e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:11.037858 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-67033229-7763-4960-aead-52351d4ca31e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:11.038446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3e68f323-e666-4f22-8034-649672a99335 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:11.039048 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-67033229-7763-4960-aead-52351d4ca31e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:11.039247 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-67033229-7763-4960-aead-52351d4ca31e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:11.039552 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3e68f323-e666-4f22-8034-649672a99335 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:11.048200 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3e68f323-e666-4f22-8034-649672a99335 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:11.048747 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3e68f323-e666-4f22-8034-649672a99335 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:11.049698 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3e68f323-e666-4f22-8034-649672a99335 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:11.050197 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3e68f323-e666-4f22-8034-649672a99335 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:11.128313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-67033229-7763-4960-aead-52351d4ca31e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.105098 Nov 11 20:45:11.129025 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 648/1170] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:11 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:11.203724 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3e68f323-e666-4f22-8034-649672a99335 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:11.211699 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3e68f323-e666-4f22-8034-649672a99335 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1260 microversion: 2.1 time: 0.179760 Nov 11 20:45:11.212205 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 523/1171] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:11 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:12.140370 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e223d8dc-06d0-4db0-8e2d-1daca1bc8ab0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:12.141414 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e223d8dc-06d0-4db0-8e2d-1daca1bc8ab0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:12.148419 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e223d8dc-06d0-4db0-8e2d-1daca1bc8ab0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:12.148869 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e223d8dc-06d0-4db0-8e2d-1daca1bc8ab0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:12.149675 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e223d8dc-06d0-4db0-8e2d-1daca1bc8ab0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:12.150133 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e223d8dc-06d0-4db0-8e2d-1daca1bc8ab0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:12.220302 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e223d8dc-06d0-4db0-8e2d-1daca1bc8ab0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.084088 Nov 11 20:45:12.220930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 649/1172] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:12 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:12.228092 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8cdabec6-0dd0-4ee2-be68-0c27793a3c14 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:12.228695 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8cdabec6-0dd0-4ee2-be68-0c27793a3c14 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:12.235493 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8cdabec6-0dd0-4ee2-be68-0c27793a3c14 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:12.235943 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8cdabec6-0dd0-4ee2-be68-0c27793a3c14 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:12.236743 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8cdabec6-0dd0-4ee2-be68-0c27793a3c14 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:12.237200 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8cdabec6-0dd0-4ee2-be68-0c27793a3c14 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:12.372494 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-8cdabec6-0dd0-4ee2-be68-0c27793a3c14 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:12.380639 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8cdabec6-0dd0-4ee2-be68-0c27793a3c14 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1260 microversion: 2.1 time: 0.156415 Nov 11 20:45:12.381222 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 524/1173] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:12 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:13.231683 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fda68b50-324b-4f1d-8a0d-224f3cebff94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:13.232717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fda68b50-324b-4f1d-8a0d-224f3cebff94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:13.241011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fda68b50-324b-4f1d-8a0d-224f3cebff94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:13.241455 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fda68b50-324b-4f1d-8a0d-224f3cebff94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:13.242241 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fda68b50-324b-4f1d-8a0d-224f3cebff94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:13.242676 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fda68b50-324b-4f1d-8a0d-224f3cebff94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:13.334200 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fda68b50-324b-4f1d-8a0d-224f3cebff94 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.106332 Nov 11 20:45:13.334838 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 650/1174] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:13 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:13.398863 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f50a8f5d-daf7-4549-9a5f-dc7b3ef3148d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:13.399392 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f50a8f5d-daf7-4549-9a5f-dc7b3ef3148d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:13.406203 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f50a8f5d-daf7-4549-9a5f-dc7b3ef3148d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:13.406739 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f50a8f5d-daf7-4549-9a5f-dc7b3ef3148d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:13.407544 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f50a8f5d-daf7-4549-9a5f-dc7b3ef3148d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:13.407986 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f50a8f5d-daf7-4549-9a5f-dc7b3ef3148d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:13.542686 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-f50a8f5d-daf7-4549-9a5f-dc7b3ef3148d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:13.551039 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f50a8f5d-daf7-4549-9a5f-dc7b3ef3148d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1260 microversion: 2.1 time: 0.155921 Nov 11 20:45:13.551620 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 525/1175] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:13 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:14.345968 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-899bba11-8f76-476a-b8b2-9e348829811e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:14.346981 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-899bba11-8f76-476a-b8b2-9e348829811e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:14.354014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-899bba11-8f76-476a-b8b2-9e348829811e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:14.354461 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-899bba11-8f76-476a-b8b2-9e348829811e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:14.355296 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-899bba11-8f76-476a-b8b2-9e348829811e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:14.356050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-899bba11-8f76-476a-b8b2-9e348829811e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:14.430576 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-3d8bdf23-8525-4608-864e-f418edeb5127 req-7a60cad1-e92c-4c73-912e-f24feb506eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a4baaf-615d-4da4-b61e-5a9199179627", "name": "network-vif-plugged", "status": "completed", "tag": "40bfc231-ecda-4dd7-a914-d4fd0a2d487b"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:14.432243 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:45:14.432243 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:45:14.433027 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-899bba11-8f76-476a-b8b2-9e348829811e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.090419 Nov 11 20:45:14.435251 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 651/1176] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:14 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:14.440906 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-3d8bdf23-8525-4608-864e-f418edeb5127 req-7a60cad1-e92c-4c73-912e-f24feb506eae service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:14.441325 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-3d8bdf23-8525-4608-864e-f418edeb5127 req-7a60cad1-e92c-4c73-912e-f24feb506eae service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:14.454335 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-3d8bdf23-8525-4608-864e-f418edeb5127 req-7a60cad1-e92c-4c73-912e-f24feb506eae service nova] Creating event network-vif-plugged:40bfc231-ecda-4dd7-a914-d4fd0a2d487b for instance c9a4baaf-615d-4da4-b61e-5a9199179627 on hv-cinder-81764 Nov 11 20:45:14.459075 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-3d8bdf23-8525-4608-864e-f418edeb5127 req-7a60cad1-e92c-4c73-912e-f24feb506eae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032223 Nov 11 20:45:14.459669 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 526/1177] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:45:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:45:14.568983 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-eabfac14-d06e-47a2-a889-0af4bd3ee102 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:14.569670 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-eabfac14-d06e-47a2-a889-0af4bd3ee102 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:14.576773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eabfac14-d06e-47a2-a889-0af4bd3ee102 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:14.577219 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eabfac14-d06e-47a2-a889-0af4bd3ee102 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:14.578241 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eabfac14-d06e-47a2-a889-0af4bd3ee102 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:14.578829 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eabfac14-d06e-47a2-a889-0af4bd3ee102 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:14.746503 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-eabfac14-d06e-47a2-a889-0af4bd3ee102 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:14.755211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-eabfac14-d06e-47a2-a889-0af4bd3ee102 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1260 microversion: 2.1 time: 0.190104 Nov 11 20:45:14.755731 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 652/1178] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:14 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:15.445800 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c319d154-92a7-4d68-a217-91d05be840bd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:15.446790 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c319d154-92a7-4d68-a217-91d05be840bd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:15.453743 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c319d154-92a7-4d68-a217-91d05be840bd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:15.454215 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c319d154-92a7-4d68-a217-91d05be840bd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:15.455014 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c319d154-92a7-4d68-a217-91d05be840bd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:15.455454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c319d154-92a7-4d68-a217-91d05be840bd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:15.535036 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c319d154-92a7-4d68-a217-91d05be840bd tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.093976 Nov 11 20:45:15.535714 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 527/1179] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:15 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:15.772874 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-921a3149-7320-4863-93e6-7a40409ee4ca tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:15.773423 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-921a3149-7320-4863-93e6-7a40409ee4ca tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:15.779832 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-921a3149-7320-4863-93e6-7a40409ee4ca tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:15.780338 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-921a3149-7320-4863-93e6-7a40409ee4ca tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:15.781171 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-921a3149-7320-4863-93e6-7a40409ee4ca tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:15.781600 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-921a3149-7320-4863-93e6-7a40409ee4ca tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:15.929004 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-921a3149-7320-4863-93e6-7a40409ee4ca tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:15.936443 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-921a3149-7320-4863-93e6-7a40409ee4ca tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1260 microversion: 2.1 time: 0.167667 Nov 11 20:45:15.937639 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 653/1180] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:15 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:16.548935 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-937782f7-fefd-4302-a3de-2d02f1ef70e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:16.549844 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-937782f7-fefd-4302-a3de-2d02f1ef70e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:16.557735 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-937782f7-fefd-4302-a3de-2d02f1ef70e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:16.558173 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-937782f7-fefd-4302-a3de-2d02f1ef70e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:16.558963 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-937782f7-fefd-4302-a3de-2d02f1ef70e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:16.559390 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-937782f7-fefd-4302-a3de-2d02f1ef70e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:16.651040 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-937782f7-fefd-4302-a3de-2d02f1ef70e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.105541 Nov 11 20:45:16.653918 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 528/1181] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:16 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:16.955800 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-48f0d09b-89f6-44aa-b0b5-105285b3fba9 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:16.956465 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-48f0d09b-89f6-44aa-b0b5-105285b3fba9 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:16.963371 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-48f0d09b-89f6-44aa-b0b5-105285b3fba9 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:16.963773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-48f0d09b-89f6-44aa-b0b5-105285b3fba9 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:16.964597 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-48f0d09b-89f6-44aa-b0b5-105285b3fba9 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:16.965029 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-48f0d09b-89f6-44aa-b0b5-105285b3fba9 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:17.098789 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-48f0d09b-89f6-44aa-b0b5-105285b3fba9 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:17.106341 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-48f0d09b-89f6-44aa-b0b5-105285b3fba9 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1445 microversion: 2.1 time: 0.155031 Nov 11 20:45:17.106914 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 654/1182] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:16 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:17.122841 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8be16657-ba0c-49cc-b86e-8296690704fd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:17.123529 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8be16657-ba0c-49cc-b86e-8296690704fd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:17.131292 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8be16657-ba0c-49cc-b86e-8296690704fd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:17.131711 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8be16657-ba0c-49cc-b86e-8296690704fd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:17.132544 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8be16657-ba0c-49cc-b86e-8296690704fd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:17.132972 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8be16657-ba0c-49cc-b86e-8296690704fd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:17.272990 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-8be16657-ba0c-49cc-b86e-8296690704fd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:17.280943 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8be16657-ba0c-49cc-b86e-8296690704fd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1445 microversion: 2.1 time: 0.162016 Nov 11 20:45:17.281545 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 529/1183] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:17 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1445 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:17.661813 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b5f0a854-b59c-47a5-a308-7d452ccf355e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:17.662764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b5f0a854-b59c-47a5-a308-7d452ccf355e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:17.669296 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b5f0a854-b59c-47a5-a308-7d452ccf355e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:17.669745 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b5f0a854-b59c-47a5-a308-7d452ccf355e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:17.670535 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b5f0a854-b59c-47a5-a308-7d452ccf355e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:17.670978 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b5f0a854-b59c-47a5-a308-7d452ccf355e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:17.753501 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b5f0a854-b59c-47a5-a308-7d452ccf355e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.095168 Nov 11 20:45:17.756679 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 655/1184] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:17 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:18.764208 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-110bb024-7540-4ab2-9da7-a877a5569d1a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:18.765203 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-110bb024-7540-4ab2-9da7-a877a5569d1a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:18.773374 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-110bb024-7540-4ab2-9da7-a877a5569d1a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:18.773998 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-110bb024-7540-4ab2-9da7-a877a5569d1a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:18.775199 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-110bb024-7540-4ab2-9da7-a877a5569d1a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:18.775696 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-110bb024-7540-4ab2-9da7-a877a5569d1a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:18.864429 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-110bb024-7540-4ab2-9da7-a877a5569d1a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.103737 Nov 11 20:45:18.865084 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 530/1185] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:18 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:19.344960 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-bede60a2-9ad2-4950-a937-a1bce689e39f req-f239d094-3ee3-40c7-a7ea-0e785cfbd444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a4baaf-615d-4da4-b61e-5a9199179627", "tag": "40bfc231-ecda-4dd7-a914-d4fd0a2d487b"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:19.346479 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:45:19.346479 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:45:19.355877 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-bede60a2-9ad2-4950-a937-a1bce689e39f req-f239d094-3ee3-40c7-a7ea-0e785cfbd444 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:19.355877 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-bede60a2-9ad2-4950-a937-a1bce689e39f req-f239d094-3ee3-40c7-a7ea-0e785cfbd444 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:19.369685 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-bede60a2-9ad2-4950-a937-a1bce689e39f req-f239d094-3ee3-40c7-a7ea-0e785cfbd444 service nova] Creating event network-changed:40bfc231-ecda-4dd7-a914-d4fd0a2d487b for instance c9a4baaf-615d-4da4-b61e-5a9199179627 on hv-cinder-81764 Nov 11 20:45:19.374915 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-bede60a2-9ad2-4950-a937-a1bce689e39f req-f239d094-3ee3-40c7-a7ea-0e785cfbd444 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034383 Nov 11 20:45:19.375513 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 656/1186] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:45:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:45:19.876991 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d0ffb626-0933-4130-a785-56f204d20ca8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:19.878009 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d0ffb626-0933-4130-a785-56f204d20ca8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:19.885448 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d0ffb626-0933-4130-a785-56f204d20ca8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:19.886196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d0ffb626-0933-4130-a785-56f204d20ca8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:19.887203 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d0ffb626-0933-4130-a785-56f204d20ca8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:19.887830 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d0ffb626-0933-4130-a785-56f204d20ca8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:19.976389 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d0ffb626-0933-4130-a785-56f204d20ca8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.103701 Nov 11 20:45:19.977655 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 531/1187] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:19 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:20.990355 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c70ae8ad-2e96-4276-8d97-0d6e453f1c22 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:20.991344 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c70ae8ad-2e96-4276-8d97-0d6e453f1c22 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:20.998383 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c70ae8ad-2e96-4276-8d97-0d6e453f1c22 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:20.999003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c70ae8ad-2e96-4276-8d97-0d6e453f1c22 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:21.000582 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c70ae8ad-2e96-4276-8d97-0d6e453f1c22 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:21.000808 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c70ae8ad-2e96-4276-8d97-0d6e453f1c22 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:21.098158 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c70ae8ad-2e96-4276-8d97-0d6e453f1c22 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.113907 Nov 11 20:45:21.098814 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 657/1188] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:20 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:22.110063 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1fb34cc4-fb8b-4cad-bce1-e469b207461f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:22.111131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1fb34cc4-fb8b-4cad-bce1-e469b207461f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:22.118339 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1fb34cc4-fb8b-4cad-bce1-e469b207461f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:22.118813 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1fb34cc4-fb8b-4cad-bce1-e469b207461f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:22.119638 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1fb34cc4-fb8b-4cad-bce1-e469b207461f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:22.120158 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1fb34cc4-fb8b-4cad-bce1-e469b207461f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:22.206667 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1fb34cc4-fb8b-4cad-bce1-e469b207461f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.100943 Nov 11 20:45:22.207348 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 532/1189] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:22 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:23.223179 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c9bda015-bf1d-4ad5-9f38-299c648f307a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:23.224227 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c9bda015-bf1d-4ad5-9f38-299c648f307a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:23.231116 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c9bda015-bf1d-4ad5-9f38-299c648f307a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:23.231562 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c9bda015-bf1d-4ad5-9f38-299c648f307a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:23.232367 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c9bda015-bf1d-4ad5-9f38-299c648f307a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:23.232802 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c9bda015-bf1d-4ad5-9f38-299c648f307a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:23.334546 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c9bda015-bf1d-4ad5-9f38-299c648f307a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 14 microversion: 2.20 time: 0.116216 Nov 11 20:45:23.335182 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 658/1190] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:23 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:45:24.349694 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8f405f6e-70f8-4ff4-806b-42b05374541b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:24.351230 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8f405f6e-70f8-4ff4-806b-42b05374541b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:24.358148 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8f405f6e-70f8-4ff4-806b-42b05374541b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:24.358597 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8f405f6e-70f8-4ff4-806b-42b05374541b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:24.359546 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8f405f6e-70f8-4ff4-806b-42b05374541b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:24.360007 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8f405f6e-70f8-4ff4-806b-42b05374541b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:24.470937 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8f405f6e-70f8-4ff4-806b-42b05374541b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 3072 microversion: 2.20 time: 0.128573 Nov 11 20:45:24.471576 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 533/1191] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:24 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 3072 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:45:25.481896 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bcade934-d3b0-43a5-b303-6766f24c182d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:25.482898 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-bcade934-d3b0-43a5-b303-6766f24c182d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:25.490600 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bcade934-d3b0-43a5-b303-6766f24c182d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:25.491042 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bcade934-d3b0-43a5-b303-6766f24c182d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:25.491818 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bcade934-d3b0-43a5-b303-6766f24c182d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:25.492347 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bcade934-d3b0-43a5-b303-6766f24c182d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:25.597981 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bcade934-d3b0-43a5-b303-6766f24c182d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 10684 microversion: 2.20 time: 0.119990 Nov 11 20:45:25.598628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 659/1192] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:25 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 10684 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:26.610461 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a2188a4d-85bc-4879-867d-b76be90d1d5f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:26.611460 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a2188a4d-85bc-4879-867d-b76be90d1d5f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:26.618324 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a2188a4d-85bc-4879-867d-b76be90d1d5f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:26.618769 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a2188a4d-85bc-4879-867d-b76be90d1d5f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:26.619548 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a2188a4d-85bc-4879-867d-b76be90d1d5f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:26.619995 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a2188a4d-85bc-4879-867d-b76be90d1d5f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:26.721450 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a2188a4d-85bc-4879-867d-b76be90d1d5f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 15064 microversion: 2.20 time: 0.115363 Nov 11 20:45:26.721959 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 534/1193] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:26 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 15064 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:27.734367 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1b89f1b7-8e42-4295-895c-a2b92d10737f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:27.735363 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1b89f1b7-8e42-4295-895c-a2b92d10737f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:27.745393 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1b89f1b7-8e42-4295-895c-a2b92d10737f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:27.745833 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1b89f1b7-8e42-4295-895c-a2b92d10737f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:27.746614 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1b89f1b7-8e42-4295-895c-a2b92d10737f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:27.747040 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1b89f1b7-8e42-4295-895c-a2b92d10737f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:27.850415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1b89f1b7-8e42-4295-895c-a2b92d10737f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 17984 microversion: 2.20 time: 0.121599 Nov 11 20:45:27.851057 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 660/1194] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:27 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 17984 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:45:28.863927 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e7bb8700-a415-4c3c-b469-2b30cd940580 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:28.865090 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e7bb8700-a415-4c3c-b469-2b30cd940580 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:28.871887 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e7bb8700-a415-4c3c-b469-2b30cd940580 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:28.872375 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e7bb8700-a415-4c3c-b469-2b30cd940580 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:28.873243 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e7bb8700-a415-4c3c-b469-2b30cd940580 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:28.873683 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e7bb8700-a415-4c3c-b469-2b30cd940580 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:28.987356 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e7bb8700-a415-4c3c-b469-2b30cd940580 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 18871 microversion: 2.20 time: 0.128898 Nov 11 20:45:28.988013 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 535/1195] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:28 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 18871 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:45:29.999285 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ae417257-13ac-4e6d-ab84-902cec3292ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:30.000927 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ae417257-13ac-4e6d-ab84-902cec3292ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:30.007770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ae417257-13ac-4e6d-ab84-902cec3292ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:30.008251 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ae417257-13ac-4e6d-ab84-902cec3292ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:30.009025 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ae417257-13ac-4e6d-ab84-902cec3292ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:30.009463 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ae417257-13ac-4e6d-ab84-902cec3292ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:30.096356 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ae417257-13ac-4e6d-ab84-902cec3292ba tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 20997 microversion: 2.20 time: 0.100929 Nov 11 20:45:30.097008 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 661/1196] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:29 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 20997 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:45:31.109348 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-bc5db944-8e0f-4405-89a3-3ebc8beb196e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:31.110565 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-bc5db944-8e0f-4405-89a3-3ebc8beb196e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:31.117815 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bc5db944-8e0f-4405-89a3-3ebc8beb196e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:31.118267 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bc5db944-8e0f-4405-89a3-3ebc8beb196e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:31.119114 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bc5db944-8e0f-4405-89a3-3ebc8beb196e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:31.119557 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bc5db944-8e0f-4405-89a3-3ebc8beb196e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:31.232867 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-bc5db944-8e0f-4405-89a3-3ebc8beb196e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 22328 microversion: 2.20 time: 0.127774 Nov 11 20:45:31.233507 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 536/1197] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:31 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 22328 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:32.245330 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-52667c65-415d-4319-a3f4-bea5b664105e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:32.246319 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-52667c65-415d-4319-a3f4-bea5b664105e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:32.253293 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-52667c65-415d-4319-a3f4-bea5b664105e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:32.253728 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-52667c65-415d-4319-a3f4-bea5b664105e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:32.254503 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-52667c65-415d-4319-a3f4-bea5b664105e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:32.254929 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-52667c65-415d-4319-a3f4-bea5b664105e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:32.349939 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-52667c65-415d-4319-a3f4-bea5b664105e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 23598 microversion: 2.20 time: 0.108426 Nov 11 20:45:32.350630 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 662/1198] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:32 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 23598 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:33.362082 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-98c6f109-02cd-4171-b0d8-597f80ec994e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:33.363066 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-98c6f109-02cd-4171-b0d8-597f80ec994e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:33.369789 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-98c6f109-02cd-4171-b0d8-597f80ec994e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:33.370227 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-98c6f109-02cd-4171-b0d8-597f80ec994e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:33.370991 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-98c6f109-02cd-4171-b0d8-597f80ec994e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:33.371420 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-98c6f109-02cd-4171-b0d8-597f80ec994e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:33.475954 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-98c6f109-02cd-4171-b0d8-597f80ec994e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 24503 microversion: 2.20 time: 0.117733 Nov 11 20:45:33.476917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 537/1199] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:33 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 24503 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:34.488811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-59efab15-7b7d-4e4e-a3e4-172793e020f6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:34.489791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-59efab15-7b7d-4e4e-a3e4-172793e020f6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:34.496572 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-59efab15-7b7d-4e4e-a3e4-172793e020f6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:34.497012 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-59efab15-7b7d-4e4e-a3e4-172793e020f6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:34.497811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-59efab15-7b7d-4e4e-a3e4-172793e020f6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:34.498239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-59efab15-7b7d-4e4e-a3e4-172793e020f6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:34.611549 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-59efab15-7b7d-4e4e-a3e4-172793e020f6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 25387 microversion: 2.20 time: 0.126815 Nov 11 20:45:34.612223 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 663/1200] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:34 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 25387 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:35.624020 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4b9ec999-46c6-4215-a916-08d29ccc2af3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:35.625072 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4b9ec999-46c6-4215-a916-08d29ccc2af3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:35.631710 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4b9ec999-46c6-4215-a916-08d29ccc2af3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:35.632175 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4b9ec999-46c6-4215-a916-08d29ccc2af3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:35.632943 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4b9ec999-46c6-4215-a916-08d29ccc2af3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:35.633369 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4b9ec999-46c6-4215-a916-08d29ccc2af3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:35.738975 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4b9ec999-46c6-4215-a916-08d29ccc2af3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 26226 microversion: 2.20 time: 0.118948 Nov 11 20:45:35.739855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 538/1201] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:35 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 26226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:36.751435 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d18cf6b6-6bd5-4992-be16-de6438fd4f91 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:36.752405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d18cf6b6-6bd5-4992-be16-de6438fd4f91 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:36.759127 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d18cf6b6-6bd5-4992-be16-de6438fd4f91 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:36.759567 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d18cf6b6-6bd5-4992-be16-de6438fd4f91 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:36.760372 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d18cf6b6-6bd5-4992-be16-de6438fd4f91 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:36.760871 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d18cf6b6-6bd5-4992-be16-de6438fd4f91 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:36.865922 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d18cf6b6-6bd5-4992-be16-de6438fd4f91 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 26961 microversion: 2.20 time: 0.118660 Nov 11 20:45:36.866576 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 664/1202] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:36 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 26961 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:37.878806 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-17f66830-757b-4f30-90c5-2054a13d6e08 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:37.879864 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-17f66830-757b-4f30-90c5-2054a13d6e08 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:37.886611 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-17f66830-757b-4f30-90c5-2054a13d6e08 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:37.887057 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-17f66830-757b-4f30-90c5-2054a13d6e08 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:37.887827 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-17f66830-757b-4f30-90c5-2054a13d6e08 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:37.888293 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-17f66830-757b-4f30-90c5-2054a13d6e08 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:37.986453 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-17f66830-757b-4f30-90c5-2054a13d6e08 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 27402 microversion: 2.20 time: 0.112288 Nov 11 20:45:37.987404 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 539/1203] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:37 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 27402 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:38.998945 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-de1609bd-5d01-4d64-8a7c-ec0fb03a5cbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:38.999338 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-de1609bd-5d01-4d64-8a7c-ec0fb03a5cbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:39.006258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-de1609bd-5d01-4d64-8a7c-ec0fb03a5cbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:39.006698 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-de1609bd-5d01-4d64-8a7c-ec0fb03a5cbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:39.007466 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-de1609bd-5d01-4d64-8a7c-ec0fb03a5cbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:39.007891 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-de1609bd-5d01-4d64-8a7c-ec0fb03a5cbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:39.099131 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-de1609bd-5d01-4d64-8a7c-ec0fb03a5cbf tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 27662 microversion: 2.20 time: 0.104703 Nov 11 20:45:39.100016 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 665/1204] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:38 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 27662 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:40.111090 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-eeb67852-8d17-4f3e-939b-8e6612b12902 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:40.112169 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-eeb67852-8d17-4f3e-939b-8e6612b12902 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:40.118936 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eeb67852-8d17-4f3e-939b-8e6612b12902 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:40.119379 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eeb67852-8d17-4f3e-939b-8e6612b12902 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:40.120182 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eeb67852-8d17-4f3e-939b-8e6612b12902 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:40.120617 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-eeb67852-8d17-4f3e-939b-8e6612b12902 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:40.228305 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-eeb67852-8d17-4f3e-939b-8e6612b12902 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 27831 microversion: 2.20 time: 0.121039 Nov 11 20:45:40.229286 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 540/1205] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:40 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 27831 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:41.240898 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4c27e712-2de3-4d3c-8ac9-5d63f80056d4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:41.241892 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4c27e712-2de3-4d3c-8ac9-5d63f80056d4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:41.248712 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4c27e712-2de3-4d3c-8ac9-5d63f80056d4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:41.249211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4c27e712-2de3-4d3c-8ac9-5d63f80056d4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:41.250165 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4c27e712-2de3-4d3c-8ac9-5d63f80056d4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:41.250797 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4c27e712-2de3-4d3c-8ac9-5d63f80056d4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:41.357307 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4c27e712-2de3-4d3c-8ac9-5d63f80056d4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 28192 microversion: 2.20 time: 0.120320 Nov 11 20:45:41.358219 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 666/1206] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:41 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 28192 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:42.370221 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c036fdb3-a6fe-4548-9f9e-b6d09fdc98f3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:42.371230 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c036fdb3-a6fe-4548-9f9e-b6d09fdc98f3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:42.378613 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c036fdb3-a6fe-4548-9f9e-b6d09fdc98f3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:42.379050 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c036fdb3-a6fe-4548-9f9e-b6d09fdc98f3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:42.379812 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c036fdb3-a6fe-4548-9f9e-b6d09fdc98f3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:42.380262 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c036fdb3-a6fe-4548-9f9e-b6d09fdc98f3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:42.459403 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c036fdb3-a6fe-4548-9f9e-b6d09fdc98f3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 28192 microversion: 2.20 time: 0.093078 Nov 11 20:45:42.460061 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 541/1207] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:42 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 28192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:45:43.471836 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ebaf0289-1db9-474e-8df9-6e29b0a01ee6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:43.472882 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ebaf0289-1db9-474e-8df9-6e29b0a01ee6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:43.479643 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ebaf0289-1db9-474e-8df9-6e29b0a01ee6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:43.480118 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ebaf0289-1db9-474e-8df9-6e29b0a01ee6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:43.480892 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ebaf0289-1db9-474e-8df9-6e29b0a01ee6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:43.481327 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ebaf0289-1db9-474e-8df9-6e29b0a01ee6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:43.603517 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ebaf0289-1db9-474e-8df9-6e29b0a01ee6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 28483 microversion: 2.20 time: 0.135665 Nov 11 20:45:43.604224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 667/1208] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:43 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 28483 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:44.615989 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7a61887f-ecad-42ff-b847-d22828d7c089 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:44.616997 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7a61887f-ecad-42ff-b847-d22828d7c089 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:44.623761 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7a61887f-ecad-42ff-b847-d22828d7c089 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:44.624309 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7a61887f-ecad-42ff-b847-d22828d7c089 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:44.625095 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7a61887f-ecad-42ff-b847-d22828d7c089 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:44.625565 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7a61887f-ecad-42ff-b847-d22828d7c089 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:44.720923 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7a61887f-ecad-42ff-b847-d22828d7c089 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 28484 microversion: 2.20 time: 0.109002 Nov 11 20:45:44.721561 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 542/1209] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:44 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 28484 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:45.734036 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0be399e7-a62a-46d8-862e-8075bb4241ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:45.735140 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0be399e7-a62a-46d8-862e-8075bb4241ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:45.742144 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0be399e7-a62a-46d8-862e-8075bb4241ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:45.742592 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0be399e7-a62a-46d8-862e-8075bb4241ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:45.743366 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0be399e7-a62a-46d8-862e-8075bb4241ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:45.743880 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0be399e7-a62a-46d8-862e-8075bb4241ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:45.858456 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0be399e7-a62a-46d8-862e-8075bb4241ea tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 28651 microversion: 2.20 time: 0.128326 Nov 11 20:45:45.859124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 668/1210] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:45 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 28651 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:46.871339 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d2c0f189-5b55-4b02-9eb0-99a5c0d81603 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:46.872393 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d2c0f189-5b55-4b02-9eb0-99a5c0d81603 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:46.879389 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d2c0f189-5b55-4b02-9eb0-99a5c0d81603 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:46.879832 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d2c0f189-5b55-4b02-9eb0-99a5c0d81603 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:46.880641 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d2c0f189-5b55-4b02-9eb0-99a5c0d81603 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:46.881075 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d2c0f189-5b55-4b02-9eb0-99a5c0d81603 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:46.973660 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d2c0f189-5b55-4b02-9eb0-99a5c0d81603 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 28651 microversion: 2.20 time: 0.106385 Nov 11 20:45:46.974301 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 543/1211] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:46 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 28651 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:47.986225 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bb02aef4-058e-49fa-9391-61a8a6d03b76 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:47.987241 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-bb02aef4-058e-49fa-9391-61a8a6d03b76 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:47.994024 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bb02aef4-058e-49fa-9391-61a8a6d03b76 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:47.994450 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bb02aef4-058e-49fa-9391-61a8a6d03b76 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:47.995219 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bb02aef4-058e-49fa-9391-61a8a6d03b76 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:47.995647 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bb02aef4-058e-49fa-9391-61a8a6d03b76 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:48.081729 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bb02aef4-058e-49fa-9391-61a8a6d03b76 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 28651 microversion: 2.20 time: 0.099862 Nov 11 20:45:48.082642 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 669/1212] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:47 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 28651 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:49.093628 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-08f0caed-7afe-4707-ad25-a27d1fedb4c4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:49.094629 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-08f0caed-7afe-4707-ad25-a27d1fedb4c4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:49.101505 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-08f0caed-7afe-4707-ad25-a27d1fedb4c4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:49.101959 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-08f0caed-7afe-4707-ad25-a27d1fedb4c4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:49.102815 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-08f0caed-7afe-4707-ad25-a27d1fedb4c4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:49.103180 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-08f0caed-7afe-4707-ad25-a27d1fedb4c4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:49.186331 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-08f0caed-7afe-4707-ad25-a27d1fedb4c4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 28651 microversion: 2.20 time: 0.096882 Nov 11 20:45:49.186997 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 544/1213] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:49 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 28651 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:50.198860 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-53933817-6d82-4791-8c27-a6c35cd539be tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:50.199841 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-53933817-6d82-4791-8c27-a6c35cd539be tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:50.207344 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53933817-6d82-4791-8c27-a6c35cd539be tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:50.207789 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53933817-6d82-4791-8c27-a6c35cd539be tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:50.208598 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53933817-6d82-4791-8c27-a6c35cd539be tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:50.209025 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53933817-6d82-4791-8c27-a6c35cd539be tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:50.306964 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-53933817-6d82-4791-8c27-a6c35cd539be tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 29313 microversion: 2.20 time: 0.112108 Nov 11 20:45:50.307613 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 670/1214] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:50 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 29313 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:51.319475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5a63c5f9-c55a-40e4-8ee4-bb66be28e497 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:51.320509 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5a63c5f9-c55a-40e4-8ee4-bb66be28e497 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:51.327228 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5a63c5f9-c55a-40e4-8ee4-bb66be28e497 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:51.327665 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5a63c5f9-c55a-40e4-8ee4-bb66be28e497 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:51.329228 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5a63c5f9-c55a-40e4-8ee4-bb66be28e497 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:51.329652 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5a63c5f9-c55a-40e4-8ee4-bb66be28e497 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:51.452521 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5a63c5f9-c55a-40e4-8ee4-bb66be28e497 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 30620 microversion: 2.20 time: 0.136850 Nov 11 20:45:51.453756 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 545/1215] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:51 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 30620 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:52.465749 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ea91e7c1-3773-473d-890b-33dfad915894 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:52.466649 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ea91e7c1-3773-473d-890b-33dfad915894 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:52.474284 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ea91e7c1-3773-473d-890b-33dfad915894 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:52.474721 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ea91e7c1-3773-473d-890b-33dfad915894 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:52.475490 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ea91e7c1-3773-473d-890b-33dfad915894 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:52.475921 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ea91e7c1-3773-473d-890b-33dfad915894 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:52.579677 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ea91e7c1-3773-473d-890b-33dfad915894 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 31865 microversion: 2.20 time: 0.118207 Nov 11 20:45:52.580500 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 671/1216] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:52 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 31865 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:53.592361 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-79989c44-40f7-40f3-842d-bc66049aec17 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:53.593360 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-79989c44-40f7-40f3-842d-bc66049aec17 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:53.600687 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-79989c44-40f7-40f3-842d-bc66049aec17 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:53.601133 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-79989c44-40f7-40f3-842d-bc66049aec17 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:53.601907 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-79989c44-40f7-40f3-842d-bc66049aec17 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:53.602660 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-79989c44-40f7-40f3-842d-bc66049aec17 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:53.710903 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-79989c44-40f7-40f3-842d-bc66049aec17 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 32883 microversion: 2.20 time: 0.122733 Nov 11 20:45:53.711531 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 546/1217] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:53 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 32883 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:54.724387 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-896dc1f2-13a7-4854-a2ea-491b40c12833 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:54.725470 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-896dc1f2-13a7-4854-a2ea-491b40c12833 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:54.732568 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-896dc1f2-13a7-4854-a2ea-491b40c12833 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:54.733016 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-896dc1f2-13a7-4854-a2ea-491b40c12833 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:54.733781 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-896dc1f2-13a7-4854-a2ea-491b40c12833 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:54.734227 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-896dc1f2-13a7-4854-a2ea-491b40c12833 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:54.835273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-896dc1f2-13a7-4854-a2ea-491b40c12833 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 33480 microversion: 2.20 time: 0.115024 Nov 11 20:45:54.835911 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 672/1218] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:54 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 33480 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:55.848820 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5b0fecdc-b485-4f0d-94f9-83f3d5394543 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:55.849818 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5b0fecdc-b485-4f0d-94f9-83f3d5394543 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:55.856660 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b0fecdc-b485-4f0d-94f9-83f3d5394543 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:55.857103 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b0fecdc-b485-4f0d-94f9-83f3d5394543 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:55.857868 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b0fecdc-b485-4f0d-94f9-83f3d5394543 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:55.858299 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b0fecdc-b485-4f0d-94f9-83f3d5394543 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:55.960502 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5b0fecdc-b485-4f0d-94f9-83f3d5394543 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 34067 microversion: 2.20 time: 0.115518 Nov 11 20:45:55.964566 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 547/1219] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:55 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 34067 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:56.973296 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5f481bdf-e41a-4877-835c-fdd3de6f02c2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:56.974292 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5f481bdf-e41a-4877-835c-fdd3de6f02c2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:56.981269 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5f481bdf-e41a-4877-835c-fdd3de6f02c2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:56.981714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5f481bdf-e41a-4877-835c-fdd3de6f02c2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:56.982484 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5f481bdf-e41a-4877-835c-fdd3de6f02c2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:56.982913 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5f481bdf-e41a-4877-835c-fdd3de6f02c2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:57.245847 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5f481bdf-e41a-4877-835c-fdd3de6f02c2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 34839 microversion: 2.20 time: 0.276772 Nov 11 20:45:57.246684 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 673/1220] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:56 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 34839 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:58.258215 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fe0d66ee-b575-4f98-9be0-68469024c802 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:58.259201 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fe0d66ee-b575-4f98-9be0-68469024c802 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:58.266617 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fe0d66ee-b575-4f98-9be0-68469024c802 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:58.267123 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fe0d66ee-b575-4f98-9be0-68469024c802 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:58.267890 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fe0d66ee-b575-4f98-9be0-68469024c802 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:58.268343 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fe0d66ee-b575-4f98-9be0-68469024c802 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:58.363419 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cc0fc573-535c-47fb-8e2d-8224c4e3fe42 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:58.364432 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cc0fc573-535c-47fb-8e2d-8224c4e3fe42 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:58.371276 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cc0fc573-535c-47fb-8e2d-8224c4e3fe42 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:58.371720 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cc0fc573-535c-47fb-8e2d-8224c4e3fe42 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:58.372537 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cc0fc573-535c-47fb-8e2d-8224c4e3fe42 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:58.372969 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cc0fc573-535c-47fb-8e2d-8224c4e3fe42 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:58.373784 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fe0d66ee-b575-4f98-9be0-68469024c802 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 35367 microversion: 2.20 time: 0.119430 Nov 11 20:45:58.374708 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 548/1221] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:58 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 35367 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:58.402684 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cc0fc573-535c-47fb-8e2d-8224c4e3fe42 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044276 Nov 11 20:45:58.403221 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 674/1222] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:45:58 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:45:58.462265 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-aab4eccf-2a0b-41f5-985f-2173c10cd9f3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:58.462835 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-aab4eccf-2a0b-41f5-985f-2173c10cd9f3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:58.470074 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aab4eccf-2a0b-41f5-985f-2173c10cd9f3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:58.470568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aab4eccf-2a0b-41f5-985f-2173c10cd9f3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:58.471339 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aab4eccf-2a0b-41f5-985f-2173c10cd9f3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:58.471788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aab4eccf-2a0b-41f5-985f-2173c10cd9f3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:58.496123 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-aab4eccf-2a0b-41f5-985f-2173c10cd9f3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Going to try to terminate instance {{(pid=122527) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:45:58.570286 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-aab4eccf-2a0b-41f5-985f-2173c10cd9f3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 204 len: 0 microversion: 2.1 time: 0.111758 Nov 11 20:45:58.570882 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 549/1223] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:45:58 2021] DELETE /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:45:58.580700 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ec8c237d-0838-4a3b-a1ec-dd82ea3a9dd9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:58.581398 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ec8c237d-0838-4a3b-a1ec-dd82ea3a9dd9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:58.589102 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ec8c237d-0838-4a3b-a1ec-dd82ea3a9dd9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:58.589553 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ec8c237d-0838-4a3b-a1ec-dd82ea3a9dd9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:58.590596 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ec8c237d-0838-4a3b-a1ec-dd82ea3a9dd9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:58.591028 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ec8c237d-0838-4a3b-a1ec-dd82ea3a9dd9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:58.727036 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ec8c237d-0838-4a3b-a1ec-dd82ea3a9dd9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:58.734395 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ec8c237d-0838-4a3b-a1ec-dd82ea3a9dd9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1672 microversion: 2.1 time: 0.158857 Nov 11 20:45:58.734944 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 675/1224] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:58 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:45:59.386971 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-aeffc288-2543-4a47-85d0-874c2ea4fa78 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:45:59.387960 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-aeffc288-2543-4a47-85d0-874c2ea4fa78 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:59.394863 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aeffc288-2543-4a47-85d0-874c2ea4fa78 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:59.395299 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aeffc288-2543-4a47-85d0-874c2ea4fa78 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:59.396091 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aeffc288-2543-4a47-85d0-874c2ea4fa78 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:59.396517 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-aeffc288-2543-4a47-85d0-874c2ea4fa78 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:59.496860 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-aeffc288-2543-4a47-85d0-874c2ea4fa78 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 35936 microversion: 2.20 time: 0.113745 Nov 11 20:45:59.497493 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 550/1225] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:45:59 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 35936 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:45:59.750963 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cb70bd75-7295-44bb-b21f-b8aa463ccf32 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:45:59.751516 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cb70bd75-7295-44bb-b21f-b8aa463ccf32 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:45:59.757769 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb70bd75-7295-44bb-b21f-b8aa463ccf32 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:59.758213 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb70bd75-7295-44bb-b21f-b8aa463ccf32 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:59.758986 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb70bd75-7295-44bb-b21f-b8aa463ccf32 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:45:59.759411 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb70bd75-7295-44bb-b21f-b8aa463ccf32 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:45:59.887356 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cb70bd75-7295-44bb-b21f-b8aa463ccf32 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:45:59.895567 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cb70bd75-7295-44bb-b21f-b8aa463ccf32 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1672 microversion: 2.1 time: 0.148512 Nov 11 20:45:59.896182 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 676/1226] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:45:59 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:00.509270 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8b5e8511-0296-48a2-9169-bb502a809bef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:00.510271 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8b5e8511-0296-48a2-9169-bb502a809bef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:00.518492 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8b5e8511-0296-48a2-9169-bb502a809bef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:00.519640 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8b5e8511-0296-48a2-9169-bb502a809bef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:00.519788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8b5e8511-0296-48a2-9169-bb502a809bef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:00.520184 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8b5e8511-0296-48a2-9169-bb502a809bef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:00.622542 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8b5e8511-0296-48a2-9169-bb502a809bef tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 36753 microversion: 2.20 time: 0.117121 Nov 11 20:46:00.627513 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 551/1227] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:46:00 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 36753 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:46:00.912919 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-698a93bd-41ca-4506-b0b9-f1a0249c5b8c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:00.913485 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-698a93bd-41ca-4506-b0b9-f1a0249c5b8c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:00.919985 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-698a93bd-41ca-4506-b0b9-f1a0249c5b8c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:00.920452 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-698a93bd-41ca-4506-b0b9-f1a0249c5b8c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:00.921247 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-698a93bd-41ca-4506-b0b9-f1a0249c5b8c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:00.921686 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-698a93bd-41ca-4506-b0b9-f1a0249c5b8c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:01.025003 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-698a93bd-41ca-4506-b0b9-f1a0249c5b8c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:01.032647 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-698a93bd-41ca-4506-b0b9-f1a0249c5b8c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 200 len: 1605 microversion: 2.1 time: 0.123573 Nov 11 20:46:01.033321 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 677/1228] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:00 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 1605 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:01.247939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-4688c590-9f1c-46e3-a132-0e546efc11bd req-031f13c2-ca45-4ed2-984b-4eef74141830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03811f1-6242-47b2-be06-1ed656918ccb", "name": "network-vif-deleted", "tag": "53f23a0e-d315-46e7-8373-2a51593bddbf"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:01.250438 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:46:01.250438 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:46:01.259131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-4688c590-9f1c-46e3-a132-0e546efc11bd req-031f13c2-ca45-4ed2-984b-4eef74141830 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:01.259571 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-4688c590-9f1c-46e3-a132-0e546efc11bd req-031f13c2-ca45-4ed2-984b-4eef74141830 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:01.272161 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-4688c590-9f1c-46e3-a132-0e546efc11bd req-031f13c2-ca45-4ed2-984b-4eef74141830 service nova] Creating event network-vif-deleted:53f23a0e-d315-46e7-8373-2a51593bddbf for instance d03811f1-6242-47b2-be06-1ed656918ccb on hv-cinder-81764 Nov 11 20:46:01.276970 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-4688c590-9f1c-46e3-a132-0e546efc11bd req-031f13c2-ca45-4ed2-984b-4eef74141830 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033026 Nov 11 20:46:01.278164 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 552/1229] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:46:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:46:01.634789 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-69b6f12a-2674-4600-92c6-00c0cf95073c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:01.635731 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-69b6f12a-2674-4600-92c6-00c0cf95073c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:01.642034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-69b6f12a-2674-4600-92c6-00c0cf95073c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:01.642488 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-69b6f12a-2674-4600-92c6-00c0cf95073c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:01.643276 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-69b6f12a-2674-4600-92c6-00c0cf95073c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:01.643719 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-69b6f12a-2674-4600-92c6-00c0cf95073c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:01.754784 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-69b6f12a-2674-4600-92c6-00c0cf95073c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 37686 microversion: 2.20 time: 0.123487 Nov 11 20:46:01.758828 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 678/1230] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:46:01 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 37686 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:46:02.051704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a1ed9a68-b30d-434b-accb-6d52289d2a08 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:02.052423 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a1ed9a68-b30d-434b-accb-6d52289d2a08 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:02.059531 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1ed9a68-b30d-434b-accb-6d52289d2a08 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:02.060020 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1ed9a68-b30d-434b-accb-6d52289d2a08 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:02.060827 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1ed9a68-b30d-434b-accb-6d52289d2a08 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:02.061269 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1ed9a68-b30d-434b-accb-6d52289d2a08 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:02.076119 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-a1ed9a68-b30d-434b-accb-6d52289d2a08 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] HTTP exception thrown: Instance d03811f1-6242-47b2-be06-1ed656918ccb could not be found. Nov 11 20:46:02.076730 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a1ed9a68-b30d-434b-accb-6d52289d2a08 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Returning 404 to user: Instance d03811f1-6242-47b2-be06-1ed656918ccb could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:46:02.077565 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a1ed9a68-b30d-434b-accb-6d52289d2a08 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 404 len: 111 microversion: 2.1 time: 0.031212 Nov 11 20:46:02.078227 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 553/1231] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:02 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 11 20:46:02.087383 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b1410db8-0f50-4168-94e3-fbcf6f9252b6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '.version_select at 0x7ff3ed938940>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:02.107433 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b1410db8-0f50-4168-94e3-fbcf6f9252b6 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319015335" status: 202 len: 0 microversion: 2.1 time: 0.024287 Nov 11 20:46:02.108210 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 679/1232] 10.222.0.61 () {58 vars in 1220 bytes} [Thu Nov 11 20:46:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319015335 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:46:02.766834 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fc47e3ca-91e0-4276-af9f-437e58d2786c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'create', calling method: .version_select at 0x7ff3eda0f3a0>, body: {"keypair": {"name": "tempest-keypair-275910436"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:02.767776 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c45cf1b7-86c7-447a-bcb8-e2f6ed05cea6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:02.769396 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c45cf1b7-86c7-447a-bcb8-e2f6ed05cea6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:02.775302 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c45cf1b7-86c7-447a-bcb8-e2f6ed05cea6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:02.775757 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c45cf1b7-86c7-447a-bcb8-e2f6ed05cea6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:02.776577 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c45cf1b7-86c7-447a-bcb8-e2f6ed05cea6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:02.777014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c45cf1b7-86c7-447a-bcb8-e2f6ed05cea6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:02.780261 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-fc47e3ca-91e0-4276-af9f-437e58d2786c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Getting quotas for project b5cef6cece0f4bf49468d6d0e5b6b269. Resources: {'key_pairs'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:46:02.784102 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-fc47e3ca-91e0-4276-af9f-437e58d2786c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Getting quotas for user 4287ba46b5a349ffbb921324d6b06555 and project b5cef6cece0f4bf49468d6d0e5b6b269. Resources: {'key_pairs'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:46:02.887523 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c45cf1b7-86c7-447a-bcb8-e2f6ed05cea6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 38200 microversion: 2.20 time: 0.124480 Nov 11 20:46:02.888237 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 680/1233] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:46:02 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 38200 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:46:02.891264 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-fc47e3ca-91e0-4276-af9f-437e58d2786c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Getting quotas for project b5cef6cece0f4bf49468d6d0e5b6b269. Resources: {'key_pairs'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:46:02.894870 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-fc47e3ca-91e0-4276-af9f-437e58d2786c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Getting quotas for user 4287ba46b5a349ffbb921324d6b06555 and project b5cef6cece0f4bf49468d6d0e5b6b269. Resources: {'key_pairs'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:46:02.907629 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fc47e3ca-91e0-4276-af9f-437e58d2786c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.145511 Nov 11 20:46:02.908253 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 554/1234] 10.222.0.61 () {60 vars in 1157 bytes} [Thu Nov 11 20:46:02 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:03.900712 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fc6f31d9-71ff-43b5-8d15-bdd55c3d90f4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:03.901837 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fc6f31d9-71ff-43b5-8d15-bdd55c3d90f4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:03.909302 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fc6f31d9-71ff-43b5-8d15-bdd55c3d90f4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:03.910045 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fc6f31d9-71ff-43b5-8d15-bdd55c3d90f4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:03.910880 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fc6f31d9-71ff-43b5-8d15-bdd55c3d90f4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:03.911313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fc6f31d9-71ff-43b5-8d15-bdd55c3d90f4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:03.998143 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fc6f31d9-71ff-43b5-8d15-bdd55c3d90f4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 38200 microversion: 2.20 time: 0.101506 Nov 11 20:46:03.999629 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 681/1235] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:46:03 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 38200 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:46:04.159532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-205285489", "imageRef": "9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "515d5239-5614-4a6a-85cb-8dd4e9ebdc6b"}], "security_groups": [{"name": "tempest-securitygroup--582156772"}], "key_name": "tempest-keypair-275910436", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:04.261352 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.network.neutron [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] validate_networks() for [('515d5239-5614-4a6a-85cb-8dd4e9ebdc6b', None, None, None, None, None)] {{(pid=122527) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:46:04.627745 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Flavor limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:46:04.628214 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Image limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:46:04.628727 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Flavor pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:46:04.629212 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Image pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:46:04.629626 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:46:04.638122 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:04.638570 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:04.639386 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:04.639824 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:04.656099 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Getting quotas for project b5cef6cece0f4bf49468d6d0e5b6b269. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:46:04.660654 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Getting quotas for user 4287ba46b5a349ffbb921324d6b06555 and project b5cef6cece0f4bf49468d6d0e5b6b269. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:46:04.671141 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Going to run 1 instances... {{(pid=122527) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:46:04.673688 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9eb60af7-8d5f-435f-b5b4-4f0c0b0b3c1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:46:04.718583 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-397586a3-2e05-4383-8fc3-05a2bdb858f2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.564387 Nov 11 20:46:04.719426 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 555/1236] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:46:04 2021] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:46:04.730648 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d44d82ac-10b1-426f-b874-92158a79ad42 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:04.731336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d44d82ac-10b1-426f-b874-92158a79ad42 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:04.786449 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d44d82ac-10b1-426f-b874-92158a79ad42 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:04.793499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d44d82ac-10b1-426f-b874-92158a79ad42 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1236 microversion: 2.1 time: 0.067421 Nov 11 20:46:04.794061 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 682/1237] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:04 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:05.011461 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a6563a16-6196-48d9-a51b-a7b3a055e70a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:05.012482 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a6563a16-6196-48d9-a51b-a7b3a055e70a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:05.019909 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a6563a16-6196-48d9-a51b-a7b3a055e70a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:05.020394 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a6563a16-6196-48d9-a51b-a7b3a055e70a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:05.021214 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a6563a16-6196-48d9-a51b-a7b3a055e70a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:05.021709 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a6563a16-6196-48d9-a51b-a7b3a055e70a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:05.124116 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a6563a16-6196-48d9-a51b-a7b3a055e70a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 200 len: 38343 microversion: 2.20 time: 0.116701 Nov 11 20:46:05.124770 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 556/1238] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:46:05 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 38343 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:46:05.135493 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7fc44897-c030-4ab8-ae6e-f80ab021b396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:05.136289 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7fc44897-c030-4ab8-ae6e-f80ab021b396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:05.142706 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7fc44897-c030-4ab8-ae6e-f80ab021b396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:05.144186 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7fc44897-c030-4ab8-ae6e-f80ab021b396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:05.144714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7fc44897-c030-4ab8-ae6e-f80ab021b396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:05.145163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7fc44897-c030-4ab8-ae6e-f80ab021b396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:05.168661 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7fc44897-c030-4ab8-ae6e-f80ab021b396 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/ips" status: 200 len: 150 microversion: 2.20 time: 0.036646 Nov 11 20:46:05.169244 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 683/1239] 10.222.0.61 () {60 vars in 1288 bytes} [Thu Nov 11 20:46:05 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:46:05.811465 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a1857f34-9351-476c-ade5-72233c2314ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:05.812424 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a1857f34-9351-476c-ade5-72233c2314ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:05.820318 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1857f34-9351-476c-ade5-72233c2314ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:05.820776 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1857f34-9351-476c-ade5-72233c2314ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:05.821568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1857f34-9351-476c-ade5-72233c2314ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:05.822007 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1857f34-9351-476c-ade5-72233c2314ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:05.901844 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a1857f34-9351-476c-ade5-72233c2314ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:05.909750 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a1857f34-9351-476c-ade5-72233c2314ba tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1296 microversion: 2.1 time: 0.102880 Nov 11 20:46:05.910385 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 557/1240] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:05 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:46:06.926869 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-24e876df-ba13-48ee-be74-6d395bbbfa5d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:06.927476 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-24e876df-ba13-48ee-be74-6d395bbbfa5d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:06.933699 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-24e876df-ba13-48ee-be74-6d395bbbfa5d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:06.934139 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-24e876df-ba13-48ee-be74-6d395bbbfa5d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:06.934919 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-24e876df-ba13-48ee-be74-6d395bbbfa5d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:06.935348 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-24e876df-ba13-48ee-be74-6d395bbbfa5d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:07.174190 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-24e876df-ba13-48ee-be74-6d395bbbfa5d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:07.181700 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-24e876df-ba13-48ee-be74-6d395bbbfa5d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1361 microversion: 2.1 time: 0.258924 Nov 11 20:46:07.182271 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 684/1241] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:06 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:07.260722 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-2041c09e-4322-48dc-b78d-f8b788ed9ee9 req-85f046a2-2e5f-46f4-b257-e9c7cd3db855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "971ec047-d7f9-4d3c-92e7-c7c532ece303", "tag": "316dc164-e888-41c3-b683-64eb173a3731"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:07.262710 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:46:07.262710 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:46:07.271487 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-2041c09e-4322-48dc-b78d-f8b788ed9ee9 req-85f046a2-2e5f-46f4-b257-e9c7cd3db855 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:07.272427 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-2041c09e-4322-48dc-b78d-f8b788ed9ee9 req-85f046a2-2e5f-46f4-b257-e9c7cd3db855 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:07.285804 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-2041c09e-4322-48dc-b78d-f8b788ed9ee9 req-85f046a2-2e5f-46f4-b257-e9c7cd3db855 service nova] Creating event network-changed:316dc164-e888-41c3-b683-64eb173a3731 for instance 971ec047-d7f9-4d3c-92e7-c7c532ece303 on hv-cinder-81764 Nov 11 20:46:07.290896 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-2041c09e-4322-48dc-b78d-f8b788ed9ee9 req-85f046a2-2e5f-46f4-b257-e9c7cd3db855 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035908 Nov 11 20:46:07.291799 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 558/1242] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:46:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:46:07.509708 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cb97396e-7ab5-4505-a39d-0636bb7f2dbb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:07.510242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cb97396e-7ab5-4505-a39d-0636bb7f2dbb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:07.525363 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb97396e-7ab5-4505-a39d-0636bb7f2dbb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:07.525916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb97396e-7ab5-4505-a39d-0636bb7f2dbb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:07.526932 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb97396e-7ab5-4505-a39d-0636bb7f2dbb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:07.527364 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cb97396e-7ab5-4505-a39d-0636bb7f2dbb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:07.551846 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-cb97396e-7ab5-4505-a39d-0636bb7f2dbb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lazy-loading 'flavor' on Instance uuid 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:46:07.827036 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cb97396e-7ab5-4505-a39d-0636bb7f2dbb tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 202 len: 0 microversion: 2.20 time: 0.321066 Nov 11 20:46:07.831881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 685/1243] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:46:07 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:46:07.838430 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0efcdf26-0896-4101-95e4-c377e5dd44b0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:07.839239 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0efcdf26-0896-4101-95e4-c377e5dd44b0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:07.846441 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0efcdf26-0896-4101-95e4-c377e5dd44b0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:07.847234 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0efcdf26-0896-4101-95e4-c377e5dd44b0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:07.848171 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0efcdf26-0896-4101-95e4-c377e5dd44b0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:07.848671 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0efcdf26-0896-4101-95e4-c377e5dd44b0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:08.056637 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0efcdf26-0896-4101-95e4-c377e5dd44b0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:08.065048 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0efcdf26-0896-4101-95e4-c377e5dd44b0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:08.066533 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0efcdf26-0896-4101-95e4-c377e5dd44b0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:08.067658 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0efcdf26-0896-4101-95e4-c377e5dd44b0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.234389 Nov 11 20:46:08.068241 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 559/1244] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:07 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:08.199574 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d0a8fe60-e707-493c-9e1b-93fd442b2ff5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:08.200364 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d0a8fe60-e707-493c-9e1b-93fd442b2ff5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:08.206714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d0a8fe60-e707-493c-9e1b-93fd442b2ff5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:08.207162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d0a8fe60-e707-493c-9e1b-93fd442b2ff5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:08.207997 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d0a8fe60-e707-493c-9e1b-93fd442b2ff5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:08.208436 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d0a8fe60-e707-493c-9e1b-93fd442b2ff5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:08.413716 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d0a8fe60-e707-493c-9e1b-93fd442b2ff5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:08.420936 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d0a8fe60-e707-493c-9e1b-93fd442b2ff5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1361 microversion: 2.1 time: 0.226034 Nov 11 20:46:08.421501 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 686/1245] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:08 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:09.086911 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0ee12dce-d489-40c4-bedd-c99233c045ec tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:09.087511 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0ee12dce-d489-40c4-bedd-c99233c045ec tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:09.094011 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0ee12dce-d489-40c4-bedd-c99233c045ec tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:09.094456 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0ee12dce-d489-40c4-bedd-c99233c045ec tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:09.095341 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0ee12dce-d489-40c4-bedd-c99233c045ec tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:09.096377 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0ee12dce-d489-40c4-bedd-c99233c045ec tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:09.234532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0ee12dce-d489-40c4-bedd-c99233c045ec tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:09.242867 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0ee12dce-d489-40c4-bedd-c99233c045ec tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:09.244395 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-0ee12dce-d489-40c4-bedd-c99233c045ec tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:09.245530 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0ee12dce-d489-40c4-bedd-c99233c045ec tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.162485 Nov 11 20:46:09.246099 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 560/1246] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:09 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:09.438795 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9910333f-9c1a-4bf5-88e1-0b940d94351b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:09.440178 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9910333f-9c1a-4bf5-88e1-0b940d94351b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:09.446303 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9910333f-9c1a-4bf5-88e1-0b940d94351b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:09.446994 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9910333f-9c1a-4bf5-88e1-0b940d94351b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:09.447634 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9910333f-9c1a-4bf5-88e1-0b940d94351b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:09.448084 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9910333f-9c1a-4bf5-88e1-0b940d94351b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:09.577224 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9910333f-9c1a-4bf5-88e1-0b940d94351b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:09.584738 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9910333f-9c1a-4bf5-88e1-0b940d94351b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1361 microversion: 2.1 time: 0.150217 Nov 11 20:46:09.585342 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 687/1247] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:09 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:10.264684 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7a663847-59c3-4442-9f24-3755078698f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:10.265238 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7a663847-59c3-4442-9f24-3755078698f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:10.271583 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7a663847-59c3-4442-9f24-3755078698f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:10.272053 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7a663847-59c3-4442-9f24-3755078698f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:10.272833 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7a663847-59c3-4442-9f24-3755078698f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:10.273269 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7a663847-59c3-4442-9f24-3755078698f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:10.405530 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7a663847-59c3-4442-9f24-3755078698f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:10.413842 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7a663847-59c3-4442-9f24-3755078698f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:10.415313 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7a663847-59c3-4442-9f24-3755078698f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:10.416508 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7a663847-59c3-4442-9f24-3755078698f8 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.155773 Nov 11 20:46:10.417037 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 561/1248] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:10 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:10.602185 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e22df6b7-b2aa-4486-9360-f68bc4d8a9e0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:10.602817 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e22df6b7-b2aa-4486-9360-f68bc4d8a9e0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:10.609231 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e22df6b7-b2aa-4486-9360-f68bc4d8a9e0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:10.609683 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e22df6b7-b2aa-4486-9360-f68bc4d8a9e0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:10.610470 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e22df6b7-b2aa-4486-9360-f68bc4d8a9e0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:10.610965 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e22df6b7-b2aa-4486-9360-f68bc4d8a9e0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:10.742424 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e22df6b7-b2aa-4486-9360-f68bc4d8a9e0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:10.749635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e22df6b7-b2aa-4486-9360-f68bc4d8a9e0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1361 microversion: 2.1 time: 0.151029 Nov 11 20:46:10.750208 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 688/1249] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:10 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:11.417629 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-259d4dd6-1f68-4c71-9ddf-83e7757157b3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:11.418205 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-259d4dd6-1f68-4c71-9ddf-83e7757157b3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:11.425092 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-259d4dd6-1f68-4c71-9ddf-83e7757157b3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:11.425532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-259d4dd6-1f68-4c71-9ddf-83e7757157b3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:11.426304 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-259d4dd6-1f68-4c71-9ddf-83e7757157b3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:11.426738 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-259d4dd6-1f68-4c71-9ddf-83e7757157b3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:11.434450 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b0bb16b3-5cee-41d3-9e02-d7f12bf29a0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:11.435059 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b0bb16b3-5cee-41d3-9e02-d7f12bf29a0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:11.441033 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0bb16b3-5cee-41d3-9e02-d7f12bf29a0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:11.441480 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0bb16b3-5cee-41d3-9e02-d7f12bf29a0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:11.442262 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0bb16b3-5cee-41d3-9e02-d7f12bf29a0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:11.442698 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0bb16b3-5cee-41d3-9e02-d7f12bf29a0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:11.451522 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-259d4dd6-1f68-4c71-9ddf-83e7757157b3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Going to try to terminate instance {{(pid=122527) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:46:11.538165 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-259d4dd6-1f68-4c71-9ddf-83e7757157b3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 204 len: 0 microversion: 2.1 time: 0.123731 Nov 11 20:46:11.539490 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 562/1250] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:46:11 2021] DELETE /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:46:11.548248 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3c5ce864-d542-4854-a063-7edbc2085edf tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:11.549469 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3c5ce864-d542-4854-a063-7edbc2085edf tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:11.555356 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3c5ce864-d542-4854-a063-7edbc2085edf tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:11.555842 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3c5ce864-d542-4854-a063-7edbc2085edf tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:11.556625 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3c5ce864-d542-4854-a063-7edbc2085edf tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:11.557054 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3c5ce864-d542-4854-a063-7edbc2085edf tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:11.588851 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b0bb16b3-5cee-41d3-9e02-d7f12bf29a0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:11.598285 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b0bb16b3-5cee-41d3-9e02-d7f12bf29a0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:11.599793 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b0bb16b3-5cee-41d3-9e02-d7f12bf29a0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:11.601008 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b0bb16b3-5cee-41d3-9e02-d7f12bf29a0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.170289 Nov 11 20:46:11.601567 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 689/1251] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:11 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:11.691249 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3c5ce864-d542-4854-a063-7edbc2085edf tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:11.698636 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3c5ce864-d542-4854-a063-7edbc2085edf tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1577 microversion: 2.1 time: 0.154753 Nov 11 20:46:11.699194 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 563/1252] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:11 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:46:11.766473 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-56b6efb5-ab8c-48b3-9513-12f76453f7ca tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:11.767084 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-56b6efb5-ab8c-48b3-9513-12f76453f7ca tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:11.774247 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-56b6efb5-ab8c-48b3-9513-12f76453f7ca tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:11.774688 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-56b6efb5-ab8c-48b3-9513-12f76453f7ca tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:11.775457 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-56b6efb5-ab8c-48b3-9513-12f76453f7ca tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:11.775884 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-56b6efb5-ab8c-48b3-9513-12f76453f7ca tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:11.912156 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-56b6efb5-ab8c-48b3-9513-12f76453f7ca tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:11.919252 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-56b6efb5-ab8c-48b3-9513-12f76453f7ca tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1361 microversion: 2.1 time: 0.156479 Nov 11 20:46:11.919813 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 690/1253] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:11 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:12.619049 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a3c47068-4422-4e0b-9ff9-15cff9a30ab9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:12.619658 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a3c47068-4422-4e0b-9ff9-15cff9a30ab9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:12.625917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a3c47068-4422-4e0b-9ff9-15cff9a30ab9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:12.626363 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a3c47068-4422-4e0b-9ff9-15cff9a30ab9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:12.627184 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a3c47068-4422-4e0b-9ff9-15cff9a30ab9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:12.627620 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a3c47068-4422-4e0b-9ff9-15cff9a30ab9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:12.717147 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b5306881-74fc-411c-b79b-271d1afb17ea tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:12.717779 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b5306881-74fc-411c-b79b-271d1afb17ea tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:12.724659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b5306881-74fc-411c-b79b-271d1afb17ea tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:12.725114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b5306881-74fc-411c-b79b-271d1afb17ea tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:12.725903 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b5306881-74fc-411c-b79b-271d1afb17ea tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:12.726345 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b5306881-74fc-411c-b79b-271d1afb17ea tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:12.775481 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a3c47068-4422-4e0b-9ff9-15cff9a30ab9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:12.783770 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a3c47068-4422-4e0b-9ff9-15cff9a30ab9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:12.785310 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a3c47068-4422-4e0b-9ff9-15cff9a30ab9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:12.786460 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a3c47068-4422-4e0b-9ff9-15cff9a30ab9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.171162 Nov 11 20:46:12.787043 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 564/1254] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:12 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:12.862607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b5306881-74fc-411c-b79b-271d1afb17ea tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:12.870029 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b5306881-74fc-411c-b79b-271d1afb17ea tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1577 microversion: 2.1 time: 0.156860 Nov 11 20:46:12.870591 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 691/1255] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:12 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:46:12.936426 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-efb38677-006d-4897-9ce5-3fb05f5d7db7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:12.937025 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-efb38677-006d-4897-9ce5-3fb05f5d7db7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:12.943484 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-efb38677-006d-4897-9ce5-3fb05f5d7db7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:12.944068 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-efb38677-006d-4897-9ce5-3fb05f5d7db7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:12.944782 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-efb38677-006d-4897-9ce5-3fb05f5d7db7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:12.945213 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-efb38677-006d-4897-9ce5-3fb05f5d7db7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:13.078980 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-efb38677-006d-4897-9ce5-3fb05f5d7db7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:13.087122 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-efb38677-006d-4897-9ce5-3fb05f5d7db7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1361 microversion: 2.1 time: 0.154487 Nov 11 20:46:13.087692 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 565/1256] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:12 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:13.804359 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e2b1a61f-b075-4a60-9fdf-70dd513d5529 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:13.804956 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e2b1a61f-b075-4a60-9fdf-70dd513d5529 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:13.812198 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e2b1a61f-b075-4a60-9fdf-70dd513d5529 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:13.812644 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e2b1a61f-b075-4a60-9fdf-70dd513d5529 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:13.813431 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e2b1a61f-b075-4a60-9fdf-70dd513d5529 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:13.813845 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e2b1a61f-b075-4a60-9fdf-70dd513d5529 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:13.887855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a98235a5-8013-4d44-85ab-f93c581b93de tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:13.888621 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a98235a5-8013-4d44-85ab-f93c581b93de tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:13.895300 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a98235a5-8013-4d44-85ab-f93c581b93de tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:13.895844 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a98235a5-8013-4d44-85ab-f93c581b93de tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:13.896658 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a98235a5-8013-4d44-85ab-f93c581b93de tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:13.897121 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a98235a5-8013-4d44-85ab-f93c581b93de tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:14.077233 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e2b1a61f-b075-4a60-9fdf-70dd513d5529 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:14.086018 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e2b1a61f-b075-4a60-9fdf-70dd513d5529 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:14.087521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e2b1a61f-b075-4a60-9fdf-70dd513d5529 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:14.088713 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e2b1a61f-b075-4a60-9fdf-70dd513d5529 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.288058 Nov 11 20:46:14.089276 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 692/1257] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:13 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:14.104168 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-53f893e3-64b3-4698-acff-e9d26795bcc9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:14.104790 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-53f893e3-64b3-4698-acff-e9d26795bcc9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:14.110511 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53f893e3-64b3-4698-acff-e9d26795bcc9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:14.110966 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53f893e3-64b3-4698-acff-e9d26795bcc9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:14.111743 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53f893e3-64b3-4698-acff-e9d26795bcc9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:14.113104 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53f893e3-64b3-4698-acff-e9d26795bcc9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:14.137487 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a98235a5-8013-4d44-85ab-f93c581b93de tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:14.145670 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a98235a5-8013-4d44-85ab-f93c581b93de tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1577 microversion: 2.1 time: 0.261397 Nov 11 20:46:14.146259 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 566/1258] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:13 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1577 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:46:14.360222 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-53f893e3-64b3-4698-acff-e9d26795bcc9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:14.367594 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-53f893e3-64b3-4698-acff-e9d26795bcc9 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1361 microversion: 2.1 time: 0.267081 Nov 11 20:46:14.376678 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 693/1259] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:14 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:46:14.637601 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-bbf41d25-2e14-4d0a-9e9d-4037f5f36cc6 req-4092ee59-d157-4e12-994c-5a54c04782fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971ec047-d7f9-4d3c-92e7-c7c532ece303", "name": "network-vif-plugged", "status": "completed", "tag": "316dc164-e888-41c3-b683-64eb173a3731"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:14.639684 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:46:14.639684 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:46:14.649892 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-bbf41d25-2e14-4d0a-9e9d-4037f5f36cc6 req-4092ee59-d157-4e12-994c-5a54c04782fd service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:14.650541 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-bbf41d25-2e14-4d0a-9e9d-4037f5f36cc6 req-4092ee59-d157-4e12-994c-5a54c04782fd service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:14.665950 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-bbf41d25-2e14-4d0a-9e9d-4037f5f36cc6 req-4092ee59-d157-4e12-994c-5a54c04782fd service nova] Creating event network-vif-plugged:316dc164-e888-41c3-b683-64eb173a3731 for instance 971ec047-d7f9-4d3c-92e7-c7c532ece303 on hv-cinder-81764 Nov 11 20:46:14.671392 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-bbf41d25-2e14-4d0a-9e9d-4037f5f36cc6 req-4092ee59-d157-4e12-994c-5a54c04782fd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037638 Nov 11 20:46:14.673341 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 567/1260] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:46:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:46:14.955877 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-1552e9ef-2918-4095-a05f-b49b5799a3d3 req-199ffe4f-30a4-4026-9525-bae55f994a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6650f0-499e-492c-bb9f-6424e765a81b", "name": "network-vif-deleted", "tag": "6f3857bd-08bc-4ee4-a39a-331ef661cbbd"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:14.958160 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:46:14.958160 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:46:14.967483 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-1552e9ef-2918-4095-a05f-b49b5799a3d3 req-199ffe4f-30a4-4026-9525-bae55f994a2b service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:14.968093 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-1552e9ef-2918-4095-a05f-b49b5799a3d3 req-199ffe4f-30a4-4026-9525-bae55f994a2b service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:14.992163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-1552e9ef-2918-4095-a05f-b49b5799a3d3 req-199ffe4f-30a4-4026-9525-bae55f994a2b service nova] Creating event network-vif-deleted:6f3857bd-08bc-4ee4-a39a-331ef661cbbd for instance 1a6650f0-499e-492c-bb9f-6424e765a81b on hv-cinder-81764 Nov 11 20:46:14.997578 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-1552e9ef-2918-4095-a05f-b49b5799a3d3 req-199ffe4f-30a4-4026-9525-bae55f994a2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046045 Nov 11 20:46:14.999474 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 694/1261] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:46:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:46:15.110927 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b8c77573-6cea-408c-a667-c664fe97959e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:15.113140 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b8c77573-6cea-408c-a667-c664fe97959e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:15.119382 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b8c77573-6cea-408c-a667-c664fe97959e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:15.120086 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b8c77573-6cea-408c-a667-c664fe97959e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:15.121057 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b8c77573-6cea-408c-a667-c664fe97959e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:15.121788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b8c77573-6cea-408c-a667-c664fe97959e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:15.163099 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-62cf624c-4dec-4551-ac74-cfab2126ccdd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:15.163803 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-62cf624c-4dec-4551-ac74-cfab2126ccdd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:15.170138 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-62cf624c-4dec-4551-ac74-cfab2126ccdd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:15.170585 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-62cf624c-4dec-4551-ac74-cfab2126ccdd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:15.171374 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-62cf624c-4dec-4551-ac74-cfab2126ccdd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:15.171804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-62cf624c-4dec-4551-ac74-cfab2126ccdd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:15.246893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-62cf624c-4dec-4551-ac74-cfab2126ccdd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:15.255476 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-62cf624c-4dec-4551-ac74-cfab2126ccdd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 200 len: 1224 microversion: 2.1 time: 0.096874 Nov 11 20:46:15.256163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 695/1262] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:15 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:46:15.290334 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b8c77573-6cea-408c-a667-c664fe97959e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:15.298585 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b8c77573-6cea-408c-a667-c664fe97959e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:15.300284 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b8c77573-6cea-408c-a667-c664fe97959e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:15.301474 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b8c77573-6cea-408c-a667-c664fe97959e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.195195 Nov 11 20:46:15.302039 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 568/1263] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:15 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:15.384313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-13f41465-0ebd-4b7a-83c5-f19f279cd483 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:15.384915 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-13f41465-0ebd-4b7a-83c5-f19f279cd483 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:15.390961 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13f41465-0ebd-4b7a-83c5-f19f279cd483 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:15.391399 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13f41465-0ebd-4b7a-83c5-f19f279cd483 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:15.392209 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13f41465-0ebd-4b7a-83c5-f19f279cd483 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:15.392636 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-13f41465-0ebd-4b7a-83c5-f19f279cd483 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:15.527379 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-13f41465-0ebd-4b7a-83c5-f19f279cd483 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:15.535622 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-13f41465-0ebd-4b7a-83c5-f19f279cd483 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1361 microversion: 2.1 time: 0.154798 Nov 11 20:46:15.536412 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 696/1264] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:15 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:16.272971 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4a69aa13-1cab-4f82-b446-612f9cc49b64 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:16.273574 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4a69aa13-1cab-4f82-b446-612f9cc49b64 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:16.279840 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4a69aa13-1cab-4f82-b446-612f9cc49b64 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:16.280316 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4a69aa13-1cab-4f82-b446-612f9cc49b64 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:16.281292 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4a69aa13-1cab-4f82-b446-612f9cc49b64 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:16.281738 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4a69aa13-1cab-4f82-b446-612f9cc49b64 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:16.294765 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-4a69aa13-1cab-4f82-b446-612f9cc49b64 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] HTTP exception thrown: Instance 1a6650f0-499e-492c-bb9f-6424e765a81b could not be found. Nov 11 20:46:16.295382 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4a69aa13-1cab-4f82-b446-612f9cc49b64 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Returning 404 to user: Instance 1a6650f0-499e-492c-bb9f-6424e765a81b could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:46:16.296221 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4a69aa13-1cab-4f82-b446-612f9cc49b64 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 404 len: 111 microversion: 2.1 time: 0.027699 Nov 11 20:46:16.296761 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 569/1265] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:16 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:46:16.320503 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0ce3ea29-bc4c-4d6b-8046-f7cf5e7d989e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:16.321249 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0ce3ea29-bc4c-4d6b-8046-f7cf5e7d989e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:16.327428 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ce3ea29-bc4c-4d6b-8046-f7cf5e7d989e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:16.327881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ce3ea29-bc4c-4d6b-8046-f7cf5e7d989e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:16.328691 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ce3ea29-bc4c-4d6b-8046-f7cf5e7d989e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:16.329131 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ce3ea29-bc4c-4d6b-8046-f7cf5e7d989e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:16.398279 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-386275872", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-897741008", "security_groups": [{"name": "tempest-secgroup-smoke-1070841398"}], "block_device_mapping_v2": [{"uuid": "6511bc89-a466-45bf-8a61-c52ee47ea062", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79971f2e-5dd3-4116-8573-ccbb33e6422f"}]}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:16.466740 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0ce3ea29-bc4c-4d6b-8046-f7cf5e7d989e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:16.475671 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0ce3ea29-bc4c-4d6b-8046-f7cf5e7d989e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:16.477302 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0ce3ea29-bc4c-4d6b-8046-f7cf5e7d989e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:16.478551 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0ce3ea29-bc4c-4d6b-8046-f7cf5e7d989e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.162243 Nov 11 20:46:16.479405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 697/1266] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:16 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:16.511341 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.network.neutron [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] validate_networks() for [('79971f2e-5dd3-4116-8573-ccbb33e6422f', None, None, None, None, None)] {{(pid=122527) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:46:16.552971 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-413e76eb-a561-4ff4-ab2e-ee9d4d225642 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:16.553634 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-413e76eb-a561-4ff4-ab2e-ee9d4d225642 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:16.559323 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-413e76eb-a561-4ff4-ab2e-ee9d4d225642 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:16.559774 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-413e76eb-a561-4ff4-ab2e-ee9d4d225642 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:16.560629 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-413e76eb-a561-4ff4-ab2e-ee9d4d225642 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:16.561061 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-413e76eb-a561-4ff4-ab2e-ee9d4d225642 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:16.759694 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-413e76eb-a561-4ff4-ab2e-ee9d4d225642 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:16.767172 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-413e76eb-a561-4ff4-ab2e-ee9d4d225642 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1361 microversion: 2.1 time: 0.219030 Nov 11 20:46:16.767829 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 698/1267] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:16 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:46:16.960243 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Flavor limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:46:16.960666 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Image limits 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:46:16.961138 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Flavor pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:46:16.961577 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Image pref 0:0:0 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:46:16.961987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.virt.hardware [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122527) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:46:16.971168 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:16.972306 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:16.973170 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:16.973639 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:16.990422 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Getting quotas for project 4dd611087eb441dc94ef8c18b6b7d600. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:46:16.994257 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.quota [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Getting quotas for user 32c40f3d5b074a22b2c48caef9230615 and project 4dd611087eb441dc94ef8c18b6b7d600. Resources: {'instances', 'cores', 'ram'} {{(pid=122527) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:46:17.048525 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Going to run 1 instances... {{(pid=122527) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:46:17.051421 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6511bc89-a466-45bf-8a61-c52ee47ea062',volume_size=None,volume_type=None)] {{(pid=122527) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:46:17.176728 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-575453ce-28af-4f48-ae7c-b968d3e94001 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.782043 Nov 11 20:46:17.177382 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 570/1268] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:46:16 2021] POST /compute/v2.1/servers => generated 406 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:46:17.187640 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7a02e97b-bd04-43a1-aefd-e180052a1337 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:17.188234 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7a02e97b-bd04-43a1-aefd-e180052a1337 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:17.241752 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7a02e97b-bd04-43a1-aefd-e180052a1337 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:17.248239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7a02e97b-bd04-43a1-aefd-e180052a1337 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1093 microversion: 2.1 time: 0.064658 Nov 11 20:46:17.248988 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 699/1269] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:17 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:17.499163 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c3d24894-9845-47cf-bd46-7b955c7af05a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:17.499884 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c3d24894-9845-47cf-bd46-7b955c7af05a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:17.506947 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c3d24894-9845-47cf-bd46-7b955c7af05a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:17.507394 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c3d24894-9845-47cf-bd46-7b955c7af05a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:17.508197 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c3d24894-9845-47cf-bd46-7b955c7af05a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:17.508625 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c3d24894-9845-47cf-bd46-7b955c7af05a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:17.648058 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c3d24894-9845-47cf-bd46-7b955c7af05a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:17.656027 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c3d24894-9845-47cf-bd46-7b955c7af05a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:17.657522 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c3d24894-9845-47cf-bd46-7b955c7af05a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:17.658665 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c3d24894-9845-47cf-bd46-7b955c7af05a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.164083 Nov 11 20:46:17.659781 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 571/1270] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:17 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:17.783611 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f5123fe8-3af1-4bfc-82cb-e31c60197d92 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:17.784878 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f5123fe8-3af1-4bfc-82cb-e31c60197d92 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:17.791357 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f5123fe8-3af1-4bfc-82cb-e31c60197d92 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:17.791804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f5123fe8-3af1-4bfc-82cb-e31c60197d92 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:17.792605 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f5123fe8-3af1-4bfc-82cb-e31c60197d92 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:17.793038 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f5123fe8-3af1-4bfc-82cb-e31c60197d92 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:17.924782 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f5123fe8-3af1-4bfc-82cb-e31c60197d92 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:17.931870 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f5123fe8-3af1-4bfc-82cb-e31c60197d92 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1546 microversion: 2.1 time: 0.152056 Nov 11 20:46:17.932449 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 700/1271] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:17 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:17.947562 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-002b8094-0d14-47c2-b452-ebcbb1e33bf0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:17.948089 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-002b8094-0d14-47c2-b452-ebcbb1e33bf0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:17.953854 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-002b8094-0d14-47c2-b452-ebcbb1e33bf0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:17.954304 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-002b8094-0d14-47c2-b452-ebcbb1e33bf0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:17.955077 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-002b8094-0d14-47c2-b452-ebcbb1e33bf0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:17.955506 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-002b8094-0d14-47c2-b452-ebcbb1e33bf0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:18.044284 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-002b8094-0d14-47c2-b452-ebcbb1e33bf0 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100324 Nov 11 20:46:18.044900 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 572/1272] 10.222.0.61 () {58 vars in 1274 bytes} [Thu Nov 11 20:46:17 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:46:18.266164 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ef54f9cd-df5b-44e8-9bc8-0f297e25c8ac tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:18.266891 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ef54f9cd-df5b-44e8-9bc8-0f297e25c8ac tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:18.274138 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ef54f9cd-df5b-44e8-9bc8-0f297e25c8ac tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:18.274753 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ef54f9cd-df5b-44e8-9bc8-0f297e25c8ac tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:18.275612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ef54f9cd-df5b-44e8-9bc8-0f297e25c8ac tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:18.276161 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ef54f9cd-df5b-44e8-9bc8-0f297e25c8ac tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:18.366577 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ef54f9cd-df5b-44e8-9bc8-0f297e25c8ac tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:18.373851 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ef54f9cd-df5b-44e8-9bc8-0f297e25c8ac tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1209 microversion: 2.1 time: 0.111675 Nov 11 20:46:18.374425 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 701/1273] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:18 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:18.678894 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-cb53e2da-613b-4c4d-a732-eaea41515ca1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:18.679503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-cb53e2da-613b-4c4d-a732-eaea41515ca1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:18.692704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cb53e2da-613b-4c4d-a732-eaea41515ca1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:18.693178 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cb53e2da-613b-4c4d-a732-eaea41515ca1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:18.694293 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cb53e2da-613b-4c4d-a732-eaea41515ca1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:18.694910 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cb53e2da-613b-4c4d-a732-eaea41515ca1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:19.145836 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cb53e2da-613b-4c4d-a732-eaea41515ca1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:19.154361 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cb53e2da-613b-4c4d-a732-eaea41515ca1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:19.156624 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cb53e2da-613b-4c4d-a732-eaea41515ca1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:19.158057 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-cb53e2da-613b-4c4d-a732-eaea41515ca1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.484355 Nov 11 20:46:19.158673 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 573/1274] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:18 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:19.390949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b6abe2b1-22d6-4562-9b37-fe4eddc068ca tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:19.391562 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b6abe2b1-22d6-4562-9b37-fe4eddc068ca tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:19.399037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b6abe2b1-22d6-4562-9b37-fe4eddc068ca tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:19.399488 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b6abe2b1-22d6-4562-9b37-fe4eddc068ca tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:19.400654 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b6abe2b1-22d6-4562-9b37-fe4eddc068ca tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:19.400852 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b6abe2b1-22d6-4562-9b37-fe4eddc068ca tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:19.486922 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b6abe2b1-22d6-4562-9b37-fe4eddc068ca tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:19.494448 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b6abe2b1-22d6-4562-9b37-fe4eddc068ca tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1197 microversion: 2.1 time: 0.107197 Nov 11 20:46:19.495340 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 702/1275] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:19 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:19.985667 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-631073f8-b066-4c66-a027-215328dbc577 req-afc21dcd-25bd-46e2-a46d-85c7b8f2beaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "971ec047-d7f9-4d3c-92e7-c7c532ece303", "tag": "316dc164-e888-41c3-b683-64eb173a3731"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:19.986862 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7abb12ff-5047-4133-b207-5dd6caf4bc04 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:19.989279 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7abb12ff-5047-4133-b207-5dd6caf4bc04 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:19.990305 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:46:19.990305 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:46:20.004008 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-631073f8-b066-4c66-a027-215328dbc577 req-afc21dcd-25bd-46e2-a46d-85c7b8f2beaa service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:20.004550 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-631073f8-b066-4c66-a027-215328dbc577 req-afc21dcd-25bd-46e2-a46d-85c7b8f2beaa service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:20.009879 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7abb12ff-5047-4133-b207-5dd6caf4bc04 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:20.010557 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7abb12ff-5047-4133-b207-5dd6caf4bc04 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:20.011557 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7abb12ff-5047-4133-b207-5dd6caf4bc04 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:20.012229 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7abb12ff-5047-4133-b207-5dd6caf4bc04 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:20.031217 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-631073f8-b066-4c66-a027-215328dbc577 req-afc21dcd-25bd-46e2-a46d-85c7b8f2beaa service nova] Creating event network-changed:316dc164-e888-41c3-b683-64eb173a3731 for instance 971ec047-d7f9-4d3c-92e7-c7c532ece303 on hv-cinder-81764 Nov 11 20:46:20.037836 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-631073f8-b066-4c66-a027-215328dbc577 req-afc21dcd-25bd-46e2-a46d-85c7b8f2beaa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055474 Nov 11 20:46:20.039941 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 703/1276] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:46:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:46:20.093674 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7abb12ff-5047-4133-b207-5dd6caf4bc04 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 14 microversion: 2.1 time: 0.116492 Nov 11 20:46:20.094468 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 574/1277] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:19 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:46:20.177392 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3314b27e-d796-4de8-9a2e-ad64a7abaf02 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:20.178092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3314b27e-d796-4de8-9a2e-ad64a7abaf02 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:20.188051 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3314b27e-d796-4de8-9a2e-ad64a7abaf02 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:20.188419 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3314b27e-d796-4de8-9a2e-ad64a7abaf02 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:20.189218 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3314b27e-d796-4de8-9a2e-ad64a7abaf02 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:20.189655 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3314b27e-d796-4de8-9a2e-ad64a7abaf02 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:20.511076 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-26ea3632-c2c6-49e1-99d9-3cc1c7a6ba9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:20.512198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-26ea3632-c2c6-49e1-99d9-3cc1c7a6ba9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:20.519470 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-26ea3632-c2c6-49e1-99d9-3cc1c7a6ba9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:20.520180 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-26ea3632-c2c6-49e1-99d9-3cc1c7a6ba9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:20.521358 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-26ea3632-c2c6-49e1-99d9-3cc1c7a6ba9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:20.521873 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-26ea3632-c2c6-49e1-99d9-3cc1c7a6ba9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:20.542570 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3314b27e-d796-4de8-9a2e-ad64a7abaf02 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:20.555811 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3314b27e-d796-4de8-9a2e-ad64a7abaf02 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:20.557946 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3314b27e-d796-4de8-9a2e-ad64a7abaf02 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:20.559181 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3314b27e-d796-4de8-9a2e-ad64a7abaf02 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.386019 Nov 11 20:46:20.559743 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 704/1278] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:20 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:20.845896 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-26ea3632-c2c6-49e1-99d9-3cc1c7a6ba9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:20.854761 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-26ea3632-c2c6-49e1-99d9-3cc1c7a6ba9e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1265 microversion: 2.1 time: 0.347703 Nov 11 20:46:20.858778 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 575/1279] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:20 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1265 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:46:21.104972 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c5f93a04-ed8e-4ac7-ac24-dc204a4992b4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:21.105919 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c5f93a04-ed8e-4ac7-ac24-dc204a4992b4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:21.111720 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c5f93a04-ed8e-4ac7-ac24-dc204a4992b4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:21.112403 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c5f93a04-ed8e-4ac7-ac24-dc204a4992b4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:21.113813 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c5f93a04-ed8e-4ac7-ac24-dc204a4992b4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:21.114505 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c5f93a04-ed8e-4ac7-ac24-dc204a4992b4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:21.220039 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c5f93a04-ed8e-4ac7-ac24-dc204a4992b4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 14 microversion: 2.1 time: 0.118361 Nov 11 20:46:21.221012 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 705/1280] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:21 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:46:21.577998 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7a7421da-6167-4144-99d7-376ea181d417 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:21.578626 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7a7421da-6167-4144-99d7-376ea181d417 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:21.585796 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7a7421da-6167-4144-99d7-376ea181d417 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:21.586244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7a7421da-6167-4144-99d7-376ea181d417 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:21.587039 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7a7421da-6167-4144-99d7-376ea181d417 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:21.587467 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7a7421da-6167-4144-99d7-376ea181d417 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:21.778267 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7a7421da-6167-4144-99d7-376ea181d417 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:21.786531 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7a7421da-6167-4144-99d7-376ea181d417 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:21.788074 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-7a7421da-6167-4144-99d7-376ea181d417 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:21.789296 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7a7421da-6167-4144-99d7-376ea181d417 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.215079 Nov 11 20:46:21.789863 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 576/1281] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:21 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:21.871187 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-86913ff0-d8ca-4385-aeaf-4dc4f2e96bec tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:21.871915 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-86913ff0-d8ca-4385-aeaf-4dc4f2e96bec tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:21.879431 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-86913ff0-d8ca-4385-aeaf-4dc4f2e96bec tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:21.879887 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-86913ff0-d8ca-4385-aeaf-4dc4f2e96bec tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:21.880695 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-86913ff0-d8ca-4385-aeaf-4dc4f2e96bec tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:21.881128 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-86913ff0-d8ca-4385-aeaf-4dc4f2e96bec tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:22.056929 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-f55a31ed-1e6a-4766-9d01-03a7eb288941 req-9792c2ad-a0ce-478a-a180-0087151ef4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80e4bb44-7412-4d18-9df5-940938029647", "tag": "f2b2c706-9af8-45b8-bde7-b4119bd30e56"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:22.058416 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:46:22.058416 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:46:22.063667 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-86913ff0-d8ca-4385-aeaf-4dc4f2e96bec tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:22.065759 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-f55a31ed-1e6a-4766-9d01-03a7eb288941 req-9792c2ad-a0ce-478a-a180-0087151ef4b1 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:22.066206 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-f55a31ed-1e6a-4766-9d01-03a7eb288941 req-9792c2ad-a0ce-478a-a180-0087151ef4b1 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:22.073047 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-86913ff0-d8ca-4385-aeaf-4dc4f2e96bec tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1265 microversion: 2.1 time: 0.205895 Nov 11 20:46:22.073626 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 706/1282] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:21 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:22.087234 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-f55a31ed-1e6a-4766-9d01-03a7eb288941 req-9792c2ad-a0ce-478a-a180-0087151ef4b1 service nova] Creating event network-changed:f2b2c706-9af8-45b8-bde7-b4119bd30e56 for instance 80e4bb44-7412-4d18-9df5-940938029647 on hv-cinder-81764 Nov 11 20:46:22.092612 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-f55a31ed-1e6a-4766-9d01-03a7eb288941 req-9792c2ad-a0ce-478a-a180-0087151ef4b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039019 Nov 11 20:46:22.093379 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 577/1283] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:46:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:46:22.232149 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2270e675-d6f5-4117-a6f9-5acc80d0d98f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:22.233077 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2270e675-d6f5-4117-a6f9-5acc80d0d98f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:22.239531 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2270e675-d6f5-4117-a6f9-5acc80d0d98f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:22.240009 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2270e675-d6f5-4117-a6f9-5acc80d0d98f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:22.240809 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2270e675-d6f5-4117-a6f9-5acc80d0d98f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:22.241242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2270e675-d6f5-4117-a6f9-5acc80d0d98f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:22.327304 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2270e675-d6f5-4117-a6f9-5acc80d0d98f tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 14 microversion: 2.1 time: 0.099592 Nov 11 20:46:22.328073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 707/1284] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:22 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:46:22.808452 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-cd8e906c-eeac-4f86-b47a-8c45befc3993 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:22.809137 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-cd8e906c-eeac-4f86-b47a-8c45befc3993 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:22.815927 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cd8e906c-eeac-4f86-b47a-8c45befc3993 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:22.816390 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cd8e906c-eeac-4f86-b47a-8c45befc3993 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:22.817150 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cd8e906c-eeac-4f86-b47a-8c45befc3993 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:22.817600 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cd8e906c-eeac-4f86-b47a-8c45befc3993 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:22.958782 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cd8e906c-eeac-4f86-b47a-8c45befc3993 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:22.967712 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cd8e906c-eeac-4f86-b47a-8c45befc3993 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:22.969266 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-cd8e906c-eeac-4f86-b47a-8c45befc3993 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:22.970435 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-cd8e906c-eeac-4f86-b47a-8c45befc3993 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.166127 Nov 11 20:46:22.970966 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 578/1285] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:22 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:23.091283 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e5a166b6-1982-4de8-aea0-85d1902040a4 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:23.092027 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e5a166b6-1982-4de8-aea0-85d1902040a4 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:23.099327 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5a166b6-1982-4de8-aea0-85d1902040a4 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:23.099774 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5a166b6-1982-4de8-aea0-85d1902040a4 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:23.100599 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5a166b6-1982-4de8-aea0-85d1902040a4 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:23.101034 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5a166b6-1982-4de8-aea0-85d1902040a4 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:23.239330 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e5a166b6-1982-4de8-aea0-85d1902040a4 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:23.246559 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e5a166b6-1982-4de8-aea0-85d1902040a4 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1265 microversion: 2.1 time: 0.159729 Nov 11 20:46:23.247122 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 708/1286] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:23 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:23.338110 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-33274c34-dbd4-4d26-811e-56dc73d3cf59 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:23.339015 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-33274c34-dbd4-4d26-811e-56dc73d3cf59 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:23.345238 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-33274c34-dbd4-4d26-811e-56dc73d3cf59 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:23.345679 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-33274c34-dbd4-4d26-811e-56dc73d3cf59 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:23.346678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-33274c34-dbd4-4d26-811e-56dc73d3cf59 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:23.347799 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-33274c34-dbd4-4d26-811e-56dc73d3cf59 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:23.426708 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-33274c34-dbd4-4d26-811e-56dc73d3cf59 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 14 microversion: 2.1 time: 0.092044 Nov 11 20:46:23.427498 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 579/1287] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:23 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:46:23.988221 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-39e222f7-ca89-4148-b975-2a853d4686a4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:23.988888 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-39e222f7-ca89-4148-b975-2a853d4686a4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:23.995336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-39e222f7-ca89-4148-b975-2a853d4686a4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:23.995784 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-39e222f7-ca89-4148-b975-2a853d4686a4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:23.996607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-39e222f7-ca89-4148-b975-2a853d4686a4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:23.997051 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-39e222f7-ca89-4148-b975-2a853d4686a4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:24.130373 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-39e222f7-ca89-4148-b975-2a853d4686a4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:24.138672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-39e222f7-ca89-4148-b975-2a853d4686a4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:24.140216 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-39e222f7-ca89-4148-b975-2a853d4686a4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:24.141378 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-39e222f7-ca89-4148-b975-2a853d4686a4 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1743 microversion: 2.20 time: 0.157171 Nov 11 20:46:24.141931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 709/1288] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:23 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:24.264351 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e281d923-7e0f-438a-af80-7bbd5adbb32d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:24.265047 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e281d923-7e0f-438a-af80-7bbd5adbb32d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:24.272501 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e281d923-7e0f-438a-af80-7bbd5adbb32d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:24.272946 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e281d923-7e0f-438a-af80-7bbd5adbb32d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:24.273725 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e281d923-7e0f-438a-af80-7bbd5adbb32d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:24.274156 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e281d923-7e0f-438a-af80-7bbd5adbb32d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:24.410269 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e281d923-7e0f-438a-af80-7bbd5adbb32d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:24.417574 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e281d923-7e0f-438a-af80-7bbd5adbb32d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1265 microversion: 2.1 time: 0.157437 Nov 11 20:46:24.418127 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 580/1289] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:24 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:24.436547 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-78bb6cc5-0743-4d2d-8927-dd67b0adc46b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:24.437486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-78bb6cc5-0743-4d2d-8927-dd67b0adc46b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:24.444707 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-78bb6cc5-0743-4d2d-8927-dd67b0adc46b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:24.445153 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-78bb6cc5-0743-4d2d-8927-dd67b0adc46b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:24.445928 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-78bb6cc5-0743-4d2d-8927-dd67b0adc46b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:24.446361 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-78bb6cc5-0743-4d2d-8927-dd67b0adc46b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:24.524196 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-78bb6cc5-0743-4d2d-8927-dd67b0adc46b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 14 microversion: 2.1 time: 0.091069 Nov 11 20:46:24.525264 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 710/1290] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:24 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:46:25.161100 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c21fc35a-b74f-40b7-a687-d684d8d77e7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:25.161704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c21fc35a-b74f-40b7-a687-d684d8d77e7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:25.167960 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c21fc35a-b74f-40b7-a687-d684d8d77e7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:25.168504 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c21fc35a-b74f-40b7-a687-d684d8d77e7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:25.169276 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c21fc35a-b74f-40b7-a687-d684d8d77e7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:25.169711 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c21fc35a-b74f-40b7-a687-d684d8d77e7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:25.298473 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c21fc35a-b74f-40b7-a687-d684d8d77e7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:25.306981 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c21fc35a-b74f-40b7-a687-d684d8d77e7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:25.308501 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c21fc35a-b74f-40b7-a687-d684d8d77e7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:25.309641 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c21fc35a-b74f-40b7-a687-d684d8d77e7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1743 microversion: 2.20 time: 0.153002 Nov 11 20:46:25.310194 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 581/1291] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:25 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:25.434657 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e4b94ab2-de9a-481a-97da-8d20d2e963f7 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:25.435386 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e4b94ab2-de9a-481a-97da-8d20d2e963f7 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:25.442355 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e4b94ab2-de9a-481a-97da-8d20d2e963f7 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:25.442800 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e4b94ab2-de9a-481a-97da-8d20d2e963f7 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:25.443581 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e4b94ab2-de9a-481a-97da-8d20d2e963f7 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:25.444048 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e4b94ab2-de9a-481a-97da-8d20d2e963f7 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:25.535145 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-cf97019e-fc50-4f0c-a836-dde3517b956e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:25.536176 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-cf97019e-fc50-4f0c-a836-dde3517b956e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:25.542617 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cf97019e-fc50-4f0c-a836-dde3517b956e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:25.543126 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cf97019e-fc50-4f0c-a836-dde3517b956e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:25.543905 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cf97019e-fc50-4f0c-a836-dde3517b956e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:25.544368 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-cf97019e-fc50-4f0c-a836-dde3517b956e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:25.585742 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e4b94ab2-de9a-481a-97da-8d20d2e963f7 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:25.593988 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e4b94ab2-de9a-481a-97da-8d20d2e963f7 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1265 microversion: 2.1 time: 0.163324 Nov 11 20:46:25.594617 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 711/1292] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:25 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:25.623221 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-cf97019e-fc50-4f0c-a836-dde3517b956e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 14 microversion: 2.1 time: 0.092199 Nov 11 20:46:25.623900 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 582/1293] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:25 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:46:26.328101 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2561d510-d894-4191-9822-2f8bcf315c72 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:26.328367 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2561d510-d894-4191-9822-2f8bcf315c72 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:26.335339 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2561d510-d894-4191-9822-2f8bcf315c72 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:26.335955 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2561d510-d894-4191-9822-2f8bcf315c72 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:26.336825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2561d510-d894-4191-9822-2f8bcf315c72 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:26.337328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2561d510-d894-4191-9822-2f8bcf315c72 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:26.483913 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2561d510-d894-4191-9822-2f8bcf315c72 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:26.494787 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2561d510-d894-4191-9822-2f8bcf315c72 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:26.496394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-2561d510-d894-4191-9822-2f8bcf315c72 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:26.497805 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2561d510-d894-4191-9822-2f8bcf315c72 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1738 microversion: 2.20 time: 0.173865 Nov 11 20:46:26.498461 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 712/1294] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:26 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:26.612885 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ef2ad091-ea30-4017-8124-69b39b907903 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:26.613987 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ef2ad091-ea30-4017-8124-69b39b907903 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:26.621933 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ef2ad091-ea30-4017-8124-69b39b907903 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:26.622690 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ef2ad091-ea30-4017-8124-69b39b907903 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:26.624001 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ef2ad091-ea30-4017-8124-69b39b907903 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:26.624656 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ef2ad091-ea30-4017-8124-69b39b907903 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:26.634250 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-293faebe-13ce-4776-be5d-4eff29710cbd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:26.635888 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-293faebe-13ce-4776-be5d-4eff29710cbd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:26.646141 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-293faebe-13ce-4776-be5d-4eff29710cbd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:26.646858 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-293faebe-13ce-4776-be5d-4eff29710cbd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:26.653997 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-293faebe-13ce-4776-be5d-4eff29710cbd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:26.654679 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-293faebe-13ce-4776-be5d-4eff29710cbd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:26.726390 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-293faebe-13ce-4776-be5d-4eff29710cbd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 14 microversion: 2.1 time: 0.095820 Nov 11 20:46:26.727367 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 713/1295] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:26 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:46:26.818366 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ef2ad091-ea30-4017-8124-69b39b907903 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:26.825875 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ef2ad091-ea30-4017-8124-69b39b907903 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1265 microversion: 2.1 time: 0.217850 Nov 11 20:46:26.826446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 583/1296] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:26 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:27.517840 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-53aff4c0-83c4-4eab-a340-e30ed2de77b2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:27.518722 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-53aff4c0-83c4-4eab-a340-e30ed2de77b2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:27.525586 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53aff4c0-83c4-4eab-a340-e30ed2de77b2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:27.526030 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53aff4c0-83c4-4eab-a340-e30ed2de77b2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:27.527021 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53aff4c0-83c4-4eab-a340-e30ed2de77b2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:27.527460 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-53aff4c0-83c4-4eab-a340-e30ed2de77b2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:27.682342 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-53aff4c0-83c4-4eab-a340-e30ed2de77b2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:27.690560 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-53aff4c0-83c4-4eab-a340-e30ed2de77b2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:27.694686 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-53aff4c0-83c4-4eab-a340-e30ed2de77b2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:27.695987 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-53aff4c0-83c4-4eab-a340-e30ed2de77b2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1738 microversion: 2.20 time: 0.182226 Nov 11 20:46:27.696775 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 714/1297] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:27 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:27.738102 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-200eb8c5-b617-476b-9701-a995073e4bad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:27.739243 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-200eb8c5-b617-476b-9701-a995073e4bad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:27.745868 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-200eb8c5-b617-476b-9701-a995073e4bad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:27.746344 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-200eb8c5-b617-476b-9701-a995073e4bad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:27.747473 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-200eb8c5-b617-476b-9701-a995073e4bad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:27.748107 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-200eb8c5-b617-476b-9701-a995073e4bad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:27.826204 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-200eb8c5-b617-476b-9701-a995073e4bad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 14 microversion: 2.1 time: 0.092090 Nov 11 20:46:27.827153 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 584/1298] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:27 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:46:27.844140 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-162fda63-f168-474a-bc33-b661356c9014 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:27.845031 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-162fda63-f168-474a-bc33-b661356c9014 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:27.851750 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-162fda63-f168-474a-bc33-b661356c9014 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:27.852612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-162fda63-f168-474a-bc33-b661356c9014 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:27.853624 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-162fda63-f168-474a-bc33-b661356c9014 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:27.854164 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-162fda63-f168-474a-bc33-b661356c9014 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:28.011115 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-162fda63-f168-474a-bc33-b661356c9014 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:28.020078 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-162fda63-f168-474a-bc33-b661356c9014 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1265 microversion: 2.1 time: 0.181200 Nov 11 20:46:28.024170 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 715/1299] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:27 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:28.716517 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3f875d5c-7b9a-49d3-b157-4b9728d5c643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:28.717281 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3f875d5c-7b9a-49d3-b157-4b9728d5c643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:28.725949 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3f875d5c-7b9a-49d3-b157-4b9728d5c643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:28.726576 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3f875d5c-7b9a-49d3-b157-4b9728d5c643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:28.727654 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3f875d5c-7b9a-49d3-b157-4b9728d5c643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:28.728275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3f875d5c-7b9a-49d3-b157-4b9728d5c643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:28.735117 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-f431b1b2-36a8-4d1f-9a98-4148e1ffdc17 req-a8ae11f9-89d7-45e8-b34a-5df45c747ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e", "name": "network-vif-plugged", "status": "completed", "tag": "962e998a-c58f-4876-b93f-8de3af37c538"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:28.737470 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:46:28.737470 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:46:28.751744 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-f431b1b2-36a8-4d1f-9a98-4148e1ffdc17 req-a8ae11f9-89d7-45e8-b34a-5df45c747ac8 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:28.751744 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-f431b1b2-36a8-4d1f-9a98-4148e1ffdc17 req-a8ae11f9-89d7-45e8-b34a-5df45c747ac8 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:28.767159 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-f431b1b2-36a8-4d1f-9a98-4148e1ffdc17 req-a8ae11f9-89d7-45e8-b34a-5df45c747ac8 service nova] Creating event network-vif-plugged:962e998a-c58f-4876-b93f-8de3af37c538 for instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e on hv-cinder-81764 Nov 11 20:46:28.777689 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-f431b1b2-36a8-4d1f-9a98-4148e1ffdc17 req-a8ae11f9-89d7-45e8-b34a-5df45c747ac8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046917 Nov 11 20:46:28.779105 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 716/1300] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:46:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:46:28.839434 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7e858ee4-a7f2-47a9-bcfb-e8bccd899959 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:28.840564 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7e858ee4-a7f2-47a9-bcfb-e8bccd899959 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:28.847501 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7e858ee4-a7f2-47a9-bcfb-e8bccd899959 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:28.847980 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7e858ee4-a7f2-47a9-bcfb-e8bccd899959 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:28.848791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7e858ee4-a7f2-47a9-bcfb-e8bccd899959 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:28.849219 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7e858ee4-a7f2-47a9-bcfb-e8bccd899959 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:28.927581 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7e858ee4-a7f2-47a9-bcfb-e8bccd899959 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 14 microversion: 2.1 time: 0.088432 Nov 11 20:46:28.928341 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 717/1301] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:28 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 11 20:46:28.942471 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3f875d5c-7b9a-49d3-b157-4b9728d5c643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:28.952926 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3f875d5c-7b9a-49d3-b157-4b9728d5c643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:28.954744 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3f875d5c-7b9a-49d3-b157-4b9728d5c643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:28.955998 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3f875d5c-7b9a-49d3-b157-4b9728d5c643 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1738 microversion: 2.20 time: 0.244484 Nov 11 20:46:28.970696 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 585/1302] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:28 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:29.042701 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cbb99b07-7dee-451a-bf79-2f755346d8e2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:29.043491 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cbb99b07-7dee-451a-bf79-2f755346d8e2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:29.053970 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cbb99b07-7dee-451a-bf79-2f755346d8e2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:29.054511 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cbb99b07-7dee-451a-bf79-2f755346d8e2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:29.055396 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cbb99b07-7dee-451a-bf79-2f755346d8e2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:29.055900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cbb99b07-7dee-451a-bf79-2f755346d8e2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:29.233671 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cbb99b07-7dee-451a-bf79-2f755346d8e2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:29.246089 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cbb99b07-7dee-451a-bf79-2f755346d8e2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1265 microversion: 2.1 time: 0.206853 Nov 11 20:46:29.247339 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 718/1303] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:29 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:29.938484 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-caa6e14d-7a17-48f8-996d-5e960f0b41fd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:29.939550 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-caa6e14d-7a17-48f8-996d-5e960f0b41fd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:29.947999 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-caa6e14d-7a17-48f8-996d-5e960f0b41fd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:29.949203 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-caa6e14d-7a17-48f8-996d-5e960f0b41fd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:29.949994 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-caa6e14d-7a17-48f8-996d-5e960f0b41fd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:29.950420 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-caa6e14d-7a17-48f8-996d-5e960f0b41fd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:29.977688 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-58d8315b-d4e2-4c8b-b9f0-754f60997366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:29.978302 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-58d8315b-d4e2-4c8b-b9f0-754f60997366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:29.984776 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-58d8315b-d4e2-4c8b-b9f0-754f60997366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:29.985230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-58d8315b-d4e2-4c8b-b9f0-754f60997366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:29.986026 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-58d8315b-d4e2-4c8b-b9f0-754f60997366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:29.986461 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-58d8315b-d4e2-4c8b-b9f0-754f60997366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:30.032406 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-caa6e14d-7a17-48f8-996d-5e960f0b41fd tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 14 microversion: 2.1 time: 0.097433 Nov 11 20:46:30.033070 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 586/1304] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:29 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:46:30.133619 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-58d8315b-d4e2-4c8b-b9f0-754f60997366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:30.145743 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-58d8315b-d4e2-4c8b-b9f0-754f60997366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:30.147258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-58d8315b-d4e2-4c8b-b9f0-754f60997366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:30.148488 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-58d8315b-d4e2-4c8b-b9f0-754f60997366 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1738 microversion: 2.20 time: 0.174613 Nov 11 20:46:30.149405 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 719/1305] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:29 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:30.266286 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6f1d9907-b668-4c04-92c9-7d4212a03dcd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:30.270576 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6f1d9907-b668-4c04-92c9-7d4212a03dcd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:30.278887 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f1d9907-b668-4c04-92c9-7d4212a03dcd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:30.279637 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f1d9907-b668-4c04-92c9-7d4212a03dcd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:30.280616 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f1d9907-b668-4c04-92c9-7d4212a03dcd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:30.281143 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f1d9907-b668-4c04-92c9-7d4212a03dcd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:30.449550 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-6f1d9907-b668-4c04-92c9-7d4212a03dcd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:30.461823 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6f1d9907-b668-4c04-92c9-7d4212a03dcd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1265 microversion: 2.1 time: 0.202353 Nov 11 20:46:30.472691 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 587/1306] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:30 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:31.045223 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f2457a8c-1810-43c1-8fbe-c8526b054624 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:31.046362 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f2457a8c-1810-43c1-8fbe-c8526b054624 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:31.054149 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f2457a8c-1810-43c1-8fbe-c8526b054624 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:31.054845 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f2457a8c-1810-43c1-8fbe-c8526b054624 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:31.055717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f2457a8c-1810-43c1-8fbe-c8526b054624 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:31.056273 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f2457a8c-1810-43c1-8fbe-c8526b054624 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:31.140162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f2457a8c-1810-43c1-8fbe-c8526b054624 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 14 microversion: 2.1 time: 0.099244 Nov 11 20:46:31.144486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 720/1307] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:31 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:46:31.168516 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-13551aae-4f7b-451b-a90f-f3305bdc108c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:31.169248 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-13551aae-4f7b-451b-a90f-f3305bdc108c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:31.177284 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-13551aae-4f7b-451b-a90f-f3305bdc108c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:31.177825 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-13551aae-4f7b-451b-a90f-f3305bdc108c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:31.178790 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-13551aae-4f7b-451b-a90f-f3305bdc108c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:31.179255 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-13551aae-4f7b-451b-a90f-f3305bdc108c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:31.343902 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-13551aae-4f7b-451b-a90f-f3305bdc108c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:31.359586 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-13551aae-4f7b-451b-a90f-f3305bdc108c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:31.361712 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-13551aae-4f7b-451b-a90f-f3305bdc108c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:31.363373 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-13551aae-4f7b-451b-a90f-f3305bdc108c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1738 microversion: 2.20 time: 0.199332 Nov 11 20:46:31.369655 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 588/1308] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:31 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:31.482671 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-71e9ad8e-ab06-4989-a0ad-68371644ee0b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:31.483450 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-71e9ad8e-ab06-4989-a0ad-68371644ee0b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:31.492499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-71e9ad8e-ab06-4989-a0ad-68371644ee0b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:31.493053 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-71e9ad8e-ab06-4989-a0ad-68371644ee0b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:31.494079 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-71e9ad8e-ab06-4989-a0ad-68371644ee0b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:31.494552 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-71e9ad8e-ab06-4989-a0ad-68371644ee0b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:31.666993 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-71e9ad8e-ab06-4989-a0ad-68371644ee0b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:31.674967 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-71e9ad8e-ab06-4989-a0ad-68371644ee0b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1265 microversion: 2.1 time: 0.197296 Nov 11 20:46:31.676192 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 721/1309] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:31 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:32.153790 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-439617d8-9b61-432b-b506-d992d895efaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:32.155273 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-439617d8-9b61-432b-b506-d992d895efaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:32.165879 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-439617d8-9b61-432b-b506-d992d895efaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:32.166613 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-439617d8-9b61-432b-b506-d992d895efaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:32.167884 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-439617d8-9b61-432b-b506-d992d895efaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:32.168614 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-439617d8-9b61-432b-b506-d992d895efaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:32.272867 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-439617d8-9b61-432b-b506-d992d895efaa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 6748 microversion: 2.1 time: 0.125344 Nov 11 20:46:32.274391 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 589/1310] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:32 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 6748 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:46:32.382972 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f28d2c3f-cc0b-4c6d-a462-4b8d38026d8c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:32.383607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f28d2c3f-cc0b-4c6d-a462-4b8d38026d8c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:32.390465 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f28d2c3f-cc0b-4c6d-a462-4b8d38026d8c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:32.391154 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f28d2c3f-cc0b-4c6d-a462-4b8d38026d8c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:32.391941 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f28d2c3f-cc0b-4c6d-a462-4b8d38026d8c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:32.392407 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f28d2c3f-cc0b-4c6d-a462-4b8d38026d8c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:32.531707 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f28d2c3f-cc0b-4c6d-a462-4b8d38026d8c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:32.541245 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f28d2c3f-cc0b-4c6d-a462-4b8d38026d8c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:32.542882 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f28d2c3f-cc0b-4c6d-a462-4b8d38026d8c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:32.544382 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f28d2c3f-cc0b-4c6d-a462-4b8d38026d8c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1738 microversion: 2.20 time: 0.165192 Nov 11 20:46:32.555907 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 722/1311] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:32 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:32.693416 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-27a46156-7c95-44b3-8868-fd5cdd3eab6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:32.694227 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-27a46156-7c95-44b3-8868-fd5cdd3eab6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:32.704220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-27a46156-7c95-44b3-8868-fd5cdd3eab6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:32.705516 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-27a46156-7c95-44b3-8868-fd5cdd3eab6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:32.707367 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-27a46156-7c95-44b3-8868-fd5cdd3eab6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:32.707905 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-27a46156-7c95-44b3-8868-fd5cdd3eab6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:32.751804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-e5a2199a-2323-4d07-9197-78827ca26e65 req-8f4f3191-35fc-46e2-89bc-738fc93d031d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80e4bb44-7412-4d18-9df5-940938029647", "name": "network-vif-plugged", "status": "completed", "tag": "f2b2c706-9af8-45b8-bde7-b4119bd30e56"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:32.761896 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:46:32.761896 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:46:32.782870 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-e5a2199a-2323-4d07-9197-78827ca26e65 req-8f4f3191-35fc-46e2-89bc-738fc93d031d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:32.783465 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-e5a2199a-2323-4d07-9197-78827ca26e65 req-8f4f3191-35fc-46e2-89bc-738fc93d031d service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:32.807630 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-e5a2199a-2323-4d07-9197-78827ca26e65 req-8f4f3191-35fc-46e2-89bc-738fc93d031d service nova] Creating event network-vif-plugged:f2b2c706-9af8-45b8-bde7-b4119bd30e56 for instance 80e4bb44-7412-4d18-9df5-940938029647 on hv-cinder-81764 Nov 11 20:46:32.815381 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-e5a2199a-2323-4d07-9197-78827ca26e65 req-8f4f3191-35fc-46e2-89bc-738fc93d031d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067204 Nov 11 20:46:32.817185 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 723/1312] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:46:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:46:32.891095 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-27a46156-7c95-44b3-8868-fd5cdd3eab6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:32.899706 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-27a46156-7c95-44b3-8868-fd5cdd3eab6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1265 microversion: 2.1 time: 0.211593 Nov 11 20:46:32.900708 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 590/1313] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:32 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:33.286445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f6709c65-18af-4615-8107-40030501946a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:33.287497 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f6709c65-18af-4615-8107-40030501946a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:33.295113 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6709c65-18af-4615-8107-40030501946a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:33.295674 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6709c65-18af-4615-8107-40030501946a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:33.296571 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6709c65-18af-4615-8107-40030501946a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:33.297876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f6709c65-18af-4615-8107-40030501946a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:33.516548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f6709c65-18af-4615-8107-40030501946a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 15025 microversion: 2.1 time: 0.235111 Nov 11 20:46:33.520777 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 724/1314] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:33 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 15025 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:46:33.564776 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c9465fdb-110a-4a59-b84b-fb65d994539d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:33.565541 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c9465fdb-110a-4a59-b84b-fb65d994539d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:33.572103 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c9465fdb-110a-4a59-b84b-fb65d994539d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:33.572834 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c9465fdb-110a-4a59-b84b-fb65d994539d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:33.573934 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c9465fdb-110a-4a59-b84b-fb65d994539d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:33.574442 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c9465fdb-110a-4a59-b84b-fb65d994539d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:33.730456 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c9465fdb-110a-4a59-b84b-fb65d994539d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:33.743809 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c9465fdb-110a-4a59-b84b-fb65d994539d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:33.745753 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c9465fdb-110a-4a59-b84b-fb65d994539d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:33.747068 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c9465fdb-110a-4a59-b84b-fb65d994539d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1738 microversion: 2.20 time: 0.188234 Nov 11 20:46:33.747827 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 591/1315] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:33 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:33.921486 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a95c089c-21a9-4ce4-98b8-a7e4cd9df141 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:33.922193 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a95c089c-21a9-4ce4-98b8-a7e4cd9df141 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:33.930037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a95c089c-21a9-4ce4-98b8-a7e4cd9df141 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:33.930496 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a95c089c-21a9-4ce4-98b8-a7e4cd9df141 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:33.931291 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a95c089c-21a9-4ce4-98b8-a7e4cd9df141 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:33.931921 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a95c089c-21a9-4ce4-98b8-a7e4cd9df141 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:34.087793 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a95c089c-21a9-4ce4-98b8-a7e4cd9df141 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:34.096421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a95c089c-21a9-4ce4-98b8-a7e4cd9df141 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1265 microversion: 2.1 time: 0.182662 Nov 11 20:46:34.098869 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 725/1316] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:33 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:46:34.528357 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-756659a8-d116-43ba-aa21-ab66115ff028 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:34.529408 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-756659a8-d116-43ba-aa21-ab66115ff028 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:34.536870 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-756659a8-d116-43ba-aa21-ab66115ff028 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:34.537351 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-756659a8-d116-43ba-aa21-ab66115ff028 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:34.538290 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-756659a8-d116-43ba-aa21-ab66115ff028 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:34.538726 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-756659a8-d116-43ba-aa21-ab66115ff028 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:34.664759 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-756659a8-d116-43ba-aa21-ab66115ff028 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 17861 microversion: 2.1 time: 0.139483 Nov 11 20:46:34.665941 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 592/1317] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:34 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 17861 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:46:34.766762 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-1d508ff1-336d-4bc8-86b3-d421bf12d37f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:34.767361 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-1d508ff1-336d-4bc8-86b3-d421bf12d37f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:34.774733 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1d508ff1-336d-4bc8-86b3-d421bf12d37f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:34.775055 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1d508ff1-336d-4bc8-86b3-d421bf12d37f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:34.775839 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1d508ff1-336d-4bc8-86b3-d421bf12d37f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:34.776298 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-1d508ff1-336d-4bc8-86b3-d421bf12d37f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:34.963705 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1d508ff1-336d-4bc8-86b3-d421bf12d37f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:34.972761 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1d508ff1-336d-4bc8-86b3-d421bf12d37f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:34.974242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-1d508ff1-336d-4bc8-86b3-d421bf12d37f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:34.975799 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-1d508ff1-336d-4bc8-86b3-d421bf12d37f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1738 microversion: 2.20 time: 0.212708 Nov 11 20:46:34.976849 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 726/1318] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:34 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:35.115679 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b9101e3a-d4a6-4f3c-ac0d-6a090d081b5b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:35.117369 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b9101e3a-d4a6-4f3c-ac0d-6a090d081b5b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:35.124624 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b9101e3a-d4a6-4f3c-ac0d-6a090d081b5b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:35.125157 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b9101e3a-d4a6-4f3c-ac0d-6a090d081b5b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:35.126004 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b9101e3a-d4a6-4f3c-ac0d-6a090d081b5b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:35.126500 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b9101e3a-d4a6-4f3c-ac0d-6a090d081b5b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:35.285687 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-b9101e3a-d4a6-4f3c-ac0d-6a090d081b5b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:35.293238 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b9101e3a-d4a6-4f3c-ac0d-6a090d081b5b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1452 microversion: 2.1 time: 0.182481 Nov 11 20:46:35.293817 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 593/1319] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:35 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1452 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:35.309994 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7443e2bd-3f0e-4170-8473-fa5527d6ac02 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:35.310615 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7443e2bd-3f0e-4170-8473-fa5527d6ac02 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:35.317400 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7443e2bd-3f0e-4170-8473-fa5527d6ac02 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:35.317849 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7443e2bd-3f0e-4170-8473-fa5527d6ac02 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:35.318633 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7443e2bd-3f0e-4170-8473-fa5527d6ac02 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:35.319073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7443e2bd-3f0e-4170-8473-fa5527d6ac02 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:35.452737 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7443e2bd-3f0e-4170-8473-fa5527d6ac02 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:35.459990 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7443e2bd-3f0e-4170-8473-fa5527d6ac02 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1452 microversion: 2.1 time: 0.154063 Nov 11 20:46:35.460556 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 727/1320] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:46:35 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:46:35.676853 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9a2ed50e-efcd-4363-a5d9-e604159f3ff8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:35.677760 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9a2ed50e-efcd-4363-a5d9-e604159f3ff8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:35.683903 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9a2ed50e-efcd-4363-a5d9-e604159f3ff8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:35.684376 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9a2ed50e-efcd-4363-a5d9-e604159f3ff8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:35.685142 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9a2ed50e-efcd-4363-a5d9-e604159f3ff8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:35.685568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9a2ed50e-efcd-4363-a5d9-e604159f3ff8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:35.773253 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9a2ed50e-efcd-4363-a5d9-e604159f3ff8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 17861 microversion: 2.1 time: 0.100772 Nov 11 20:46:35.777191 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 594/1321] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:35 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 17861 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:46:35.994764 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e52fc691-cdda-475b-a3c9-d851cbaef938 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:35.995635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e52fc691-cdda-475b-a3c9-d851cbaef938 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:36.002132 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e52fc691-cdda-475b-a3c9-d851cbaef938 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:36.002582 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e52fc691-cdda-475b-a3c9-d851cbaef938 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:36.003377 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e52fc691-cdda-475b-a3c9-d851cbaef938 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:36.003999 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e52fc691-cdda-475b-a3c9-d851cbaef938 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:36.357124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e52fc691-cdda-475b-a3c9-d851cbaef938 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:36.365802 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e52fc691-cdda-475b-a3c9-d851cbaef938 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:36.367311 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e52fc691-cdda-475b-a3c9-d851cbaef938 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:36.368624 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e52fc691-cdda-475b-a3c9-d851cbaef938 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1720 microversion: 2.20 time: 0.377912 Nov 11 20:46:36.369196 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 728/1322] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:35 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1720 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:36.785886 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8dc3af1e-3c2a-4789-9ffb-506a0b4f27ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:36.787995 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8dc3af1e-3c2a-4789-9ffb-506a0b4f27ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:36.794809 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8dc3af1e-3c2a-4789-9ffb-506a0b4f27ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:36.795264 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8dc3af1e-3c2a-4789-9ffb-506a0b4f27ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:36.796099 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8dc3af1e-3c2a-4789-9ffb-506a0b4f27ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:36.796558 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8dc3af1e-3c2a-4789-9ffb-506a0b4f27ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:36.899251 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8dc3af1e-3c2a-4789-9ffb-506a0b4f27ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 19893 microversion: 2.1 time: 0.117241 Nov 11 20:46:36.903099 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 595/1323] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:36 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 19893 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:46:37.388149 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-35120c42-975c-429b-8f56-473c1b57fe3d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:37.388761 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-35120c42-975c-429b-8f56-473c1b57fe3d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:37.395882 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-35120c42-975c-429b-8f56-473c1b57fe3d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:37.396357 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-35120c42-975c-429b-8f56-473c1b57fe3d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:37.397156 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-35120c42-975c-429b-8f56-473c1b57fe3d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:37.397592 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-35120c42-975c-429b-8f56-473c1b57fe3d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:37.703647 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-35120c42-975c-429b-8f56-473c1b57fe3d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:37.712632 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-35120c42-975c-429b-8f56-473c1b57fe3d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:37.713777 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-35120c42-975c-429b-8f56-473c1b57fe3d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:37.715248 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-35120c42-975c-429b-8f56-473c1b57fe3d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1720 microversion: 2.20 time: 0.330933 Nov 11 20:46:37.715847 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 729/1324] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:37 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1720 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:37.911453 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-032e6b8d-c272-41a2-9b0c-c55b62ce30ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:37.912532 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-032e6b8d-c272-41a2-9b0c-c55b62ce30ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:37.919892 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-032e6b8d-c272-41a2-9b0c-c55b62ce30ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:37.920580 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-032e6b8d-c272-41a2-9b0c-c55b62ce30ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:37.921535 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-032e6b8d-c272-41a2-9b0c-c55b62ce30ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:37.922133 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-032e6b8d-c272-41a2-9b0c-c55b62ce30ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:37.932866 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-74a1c7d8-653b-4b5f-a545-62951dff0b86 req-6df1b7c0-43e5-4a12-a086-6a6c233eac03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80e4bb44-7412-4d18-9df5-940938029647", "tag": "f2b2c706-9af8-45b8-bde7-b4119bd30e56"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:37.934524 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:46:37.934524 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:46:37.943155 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-74a1c7d8-653b-4b5f-a545-62951dff0b86 req-6df1b7c0-43e5-4a12-a086-6a6c233eac03 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:37.943706 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-74a1c7d8-653b-4b5f-a545-62951dff0b86 req-6df1b7c0-43e5-4a12-a086-6a6c233eac03 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:37.955026 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-74a1c7d8-653b-4b5f-a545-62951dff0b86 req-6df1b7c0-43e5-4a12-a086-6a6c233eac03 service nova] Creating event network-changed:f2b2c706-9af8-45b8-bde7-b4119bd30e56 for instance 80e4bb44-7412-4d18-9df5-940938029647 on hv-cinder-81764 Nov 11 20:46:37.961148 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-74a1c7d8-653b-4b5f-a545-62951dff0b86 req-6df1b7c0-43e5-4a12-a086-6a6c233eac03 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032031 Nov 11 20:46:37.962321 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 730/1325] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:46:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:46:38.020226 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-032e6b8d-c272-41a2-9b0c-c55b62ce30ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 22119 microversion: 2.1 time: 0.111383 Nov 11 20:46:38.020891 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 596/1326] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:37 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 22119 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:46:38.735053 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cdaf7abe-a0ca-4f37-87e2-ae7d8b2d985e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:38.735746 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cdaf7abe-a0ca-4f37-87e2-ae7d8b2d985e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:38.743182 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cdaf7abe-a0ca-4f37-87e2-ae7d8b2d985e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:38.743630 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cdaf7abe-a0ca-4f37-87e2-ae7d8b2d985e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:38.744468 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cdaf7abe-a0ca-4f37-87e2-ae7d8b2d985e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:38.744901 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cdaf7abe-a0ca-4f37-87e2-ae7d8b2d985e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:38.891321 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cdaf7abe-a0ca-4f37-87e2-ae7d8b2d985e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:38.900204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cdaf7abe-a0ca-4f37-87e2-ae7d8b2d985e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:38.901675 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cdaf7abe-a0ca-4f37-87e2-ae7d8b2d985e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:38.902827 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cdaf7abe-a0ca-4f37-87e2-ae7d8b2d985e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1720 microversion: 2.20 time: 0.172708 Nov 11 20:46:38.903416 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 731/1327] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:38 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:39.032363 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-618bc1af-b412-420c-b26c-49f10df4e6a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:39.033391 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-618bc1af-b412-420c-b26c-49f10df4e6a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:39.041461 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-618bc1af-b412-420c-b26c-49f10df4e6a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:39.041912 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-618bc1af-b412-420c-b26c-49f10df4e6a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:39.042697 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-618bc1af-b412-420c-b26c-49f10df4e6a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:39.043234 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-618bc1af-b412-420c-b26c-49f10df4e6a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:39.134002 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-618bc1af-b412-420c-b26c-49f10df4e6a4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 23235 microversion: 2.1 time: 0.105499 Nov 11 20:46:39.134645 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 597/1328] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:39 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 23235 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:46:39.922061 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5b96b680-6151-45ca-a052-1bd585c58da3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:39.922658 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5b96b680-6151-45ca-a052-1bd585c58da3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:39.929541 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b96b680-6151-45ca-a052-1bd585c58da3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:39.929981 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b96b680-6151-45ca-a052-1bd585c58da3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:39.930754 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b96b680-6151-45ca-a052-1bd585c58da3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:39.931210 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5b96b680-6151-45ca-a052-1bd585c58da3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:40.066531 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5b96b680-6151-45ca-a052-1bd585c58da3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:40.074143 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5b96b680-6151-45ca-a052-1bd585c58da3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:40.075634 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5b96b680-6151-45ca-a052-1bd585c58da3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:40.076835 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5b96b680-6151-45ca-a052-1bd585c58da3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1663 microversion: 2.20 time: 0.158507 Nov 11 20:46:40.077391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 732/1329] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:39 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:40.095100 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-80d8f561-ee20-4717-bc25-866f8c3b3b37 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89d5884a-9f76-4a3d-b04c-4468d62e3e58"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:40.096227 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-80d8f561-ee20-4717-bc25-866f8c3b3b37 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:40.103454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-80d8f561-ee20-4717-bc25-866f8c3b3b37 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:40.103897 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-80d8f561-ee20-4717-bc25-866f8c3b3b37 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:40.104688 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-80d8f561-ee20-4717-bc25-866f8c3b3b37 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:40.105117 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-80d8f561-ee20-4717-bc25-866f8c3b3b37 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:40.145631 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5e6b547a-24fc-4aa7-a0f8-e1c59a8dfb83 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:40.146628 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5e6b547a-24fc-4aa7-a0f8-e1c59a8dfb83 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:40.152369 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5e6b547a-24fc-4aa7-a0f8-e1c59a8dfb83 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:40.152823 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5e6b547a-24fc-4aa7-a0f8-e1c59a8dfb83 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:40.153604 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5e6b547a-24fc-4aa7-a0f8-e1c59a8dfb83 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:40.154033 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5e6b547a-24fc-4aa7-a0f8-e1c59a8dfb83 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:40.251061 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5e6b547a-24fc-4aa7-a0f8-e1c59a8dfb83 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 24371 microversion: 2.1 time: 0.109095 Nov 11 20:46:40.257331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 733/1330] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:40 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 24371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:46:40.376597 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-80d8f561-ee20-4717-bc25-866f8c3b3b37 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.285985 Nov 11 20:46:40.377209 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 598/1331] 10.222.0.61 () {62 vars in 1363 bytes} [Thu Nov 11 20:46:40 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/os-volume_attachments => generated 188 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:46:40.486258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-dca19613-f86e-4762-892c-441bf143aab3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:40.486834 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-dca19613-f86e-4762-892c-441bf143aab3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:40.494234 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dca19613-f86e-4762-892c-441bf143aab3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:40.494677 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dca19613-f86e-4762-892c-441bf143aab3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:40.495443 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dca19613-f86e-4762-892c-441bf143aab3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:40.495870 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dca19613-f86e-4762-892c-441bf143aab3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:40.707099 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-7cfd2312-522f-4db1-bab3-d741711878ab req-c001989e-145e-48c0-bcec-ab7a83efbb3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e", "name": "network-vif-unplugged", "status": "completed", "tag": "962e998a-c58f-4876-b93f-8de3af37c538"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:40.708746 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:46:40.708746 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:46:40.719014 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-7cfd2312-522f-4db1-bab3-d741711878ab req-c001989e-145e-48c0-bcec-ab7a83efbb3e service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:40.719459 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-7cfd2312-522f-4db1-bab3-d741711878ab req-c001989e-145e-48c0-bcec-ab7a83efbb3e service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:40.739364 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.compute.server_external_events [req-7cfd2312-522f-4db1-bab3-d741711878ab req-c001989e-145e-48c0-bcec-ab7a83efbb3e service nova] Unable to find a host for instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e. Dropping event network-vif-unplugged {{(pid=122527) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 11 20:46:40.740490 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-7cfd2312-522f-4db1-bab3-d741711878ab req-c001989e-145e-48c0-bcec-ab7a83efbb3e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037612 Nov 11 20:46:40.741078 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 599/1332] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:46:40 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 11 20:46:40.756843 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-dca19613-f86e-4762-892c-441bf143aab3 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "DELETE /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/os-volume_attachments/89d5884a-9f76-4a3d-b04c-4468d62e3e58" status: 202 len: 0 microversion: 2.20 time: 0.274599 Nov 11 20:46:40.757451 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 734/1333] 10.222.0.61 () {60 vars in 1456 bytes} [Thu Nov 11 20:46:40 2021] DELETE /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/os-volume_attachments/89d5884a-9f76-4a3d-b04c-4468d62e3e58 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:46:40.813201 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b65accff-87d6-4db2-beca-babc4b9138e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:40.813775 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b65accff-87d6-4db2-beca-babc4b9138e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:40.819592 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b65accff-87d6-4db2-beca-babc4b9138e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:40.820073 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b65accff-87d6-4db2-beca-babc4b9138e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:40.820841 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b65accff-87d6-4db2-beca-babc4b9138e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:40.821266 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b65accff-87d6-4db2-beca-babc4b9138e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:40.911965 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b65accff-87d6-4db2-beca-babc4b9138e1 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action" status: 202 len: 0 microversion: 2.20 time: 0.102409 Nov 11 20:46:40.912692 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 600/1334] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Nov 11 20:46:40 2021] POST /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:46:40.923183 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-51b7395f-20b9-4dd4-9439-58c01a69b32e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:40.923900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-51b7395f-20b9-4dd4-9439-58c01a69b32e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:40.930727 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-51b7395f-20b9-4dd4-9439-58c01a69b32e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:40.931249 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-51b7395f-20b9-4dd4-9439-58c01a69b32e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:40.932075 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-51b7395f-20b9-4dd4-9439-58c01a69b32e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:40.932513 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-51b7395f-20b9-4dd4-9439-58c01a69b32e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:41.068572 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-51b7395f-20b9-4dd4-9439-58c01a69b32e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:41.077074 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-51b7395f-20b9-4dd4-9439-58c01a69b32e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:41.078635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-51b7395f-20b9-4dd4-9439-58c01a69b32e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:41.079887 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-51b7395f-20b9-4dd4-9439-58c01a69b32e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1671 microversion: 2.20 time: 0.160808 Nov 11 20:46:41.080677 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 735/1335] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:40 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:41.262576 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-63f60211-18a7-44cf-8241-2fde110fb9f7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:41.263490 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-63f60211-18a7-44cf-8241-2fde110fb9f7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:41.270998 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-63f60211-18a7-44cf-8241-2fde110fb9f7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:41.271444 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-63f60211-18a7-44cf-8241-2fde110fb9f7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:41.272259 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-63f60211-18a7-44cf-8241-2fde110fb9f7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:41.272692 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-63f60211-18a7-44cf-8241-2fde110fb9f7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:41.360830 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-63f60211-18a7-44cf-8241-2fde110fb9f7 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 25548 microversion: 2.1 time: 0.101818 Nov 11 20:46:41.365082 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 601/1336] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:41 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 25548 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:46:42.101470 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8cdc1c66-783d-407b-b1b1-58ecd5e3b5af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:42.102075 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8cdc1c66-783d-407b-b1b1-58ecd5e3b5af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:42.108470 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8cdc1c66-783d-407b-b1b1-58ecd5e3b5af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:42.108949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8cdc1c66-783d-407b-b1b1-58ecd5e3b5af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:42.109877 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8cdc1c66-783d-407b-b1b1-58ecd5e3b5af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:42.109877 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8cdc1c66-783d-407b-b1b1-58ecd5e3b5af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:42.263258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8cdc1c66-783d-407b-b1b1-58ecd5e3b5af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:42.272206 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8cdc1c66-783d-407b-b1b1-58ecd5e3b5af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:42.273714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8cdc1c66-783d-407b-b1b1-58ecd5e3b5af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:42.274940 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8cdc1c66-783d-407b-b1b1-58ecd5e3b5af tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.178221 Nov 11 20:46:42.275446 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 736/1337] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:42 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:42.373390 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-0bab1f2f-1b22-4ab2-8cef-2e88a8d16f7d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:42.374446 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-0bab1f2f-1b22-4ab2-8cef-2e88a8d16f7d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:42.382055 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0bab1f2f-1b22-4ab2-8cef-2e88a8d16f7d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:42.382519 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0bab1f2f-1b22-4ab2-8cef-2e88a8d16f7d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:42.383319 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0bab1f2f-1b22-4ab2-8cef-2e88a8d16f7d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:42.383747 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-0bab1f2f-1b22-4ab2-8cef-2e88a8d16f7d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:42.477525 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-0bab1f2f-1b22-4ab2-8cef-2e88a8d16f7d tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 26541 microversion: 2.1 time: 0.107923 Nov 11 20:46:42.478184 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 602/1338] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:42 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 26541 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:46:43.294586 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-eb47d2a3-cba6-4075-9567-f96be7fa210e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:43.295858 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-eb47d2a3-cba6-4075-9567-f96be7fa210e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:43.303269 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eb47d2a3-cba6-4075-9567-f96be7fa210e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:43.303717 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eb47d2a3-cba6-4075-9567-f96be7fa210e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:43.304548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eb47d2a3-cba6-4075-9567-f96be7fa210e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:43.304984 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-eb47d2a3-cba6-4075-9567-f96be7fa210e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:43.460538 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-eb47d2a3-cba6-4075-9567-f96be7fa210e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:43.468573 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-eb47d2a3-cba6-4075-9567-f96be7fa210e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:43.470050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-eb47d2a3-cba6-4075-9567-f96be7fa210e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:43.471188 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-eb47d2a3-cba6-4075-9567-f96be7fa210e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.180417 Nov 11 20:46:43.471770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 737/1339] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:43 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:46:43.490568 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8b8a8698-8fc6-456e-a94a-1b7d669b8e2b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:43.491579 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8b8a8698-8fc6-456e-a94a-1b7d669b8e2b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:43.498675 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8b8a8698-8fc6-456e-a94a-1b7d669b8e2b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:43.499122 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8b8a8698-8fc6-456e-a94a-1b7d669b8e2b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:43.499905 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8b8a8698-8fc6-456e-a94a-1b7d669b8e2b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:43.500358 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8b8a8698-8fc6-456e-a94a-1b7d669b8e2b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:44.489807 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-08e36d4c-d880-49fb-a04b-556351e06dc0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:44.490446 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-08e36d4c-d880-49fb-a04b-556351e06dc0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:44.497265 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-08e36d4c-d880-49fb-a04b-556351e06dc0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:44.497751 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-08e36d4c-d880-49fb-a04b-556351e06dc0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:44.498589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-08e36d4c-d880-49fb-a04b-556351e06dc0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:44.499057 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-08e36d4c-d880-49fb-a04b-556351e06dc0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:44.641697 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-08e36d4c-d880-49fb-a04b-556351e06dc0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:44.651079 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-08e36d4c-d880-49fb-a04b-556351e06dc0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:44.652618 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-08e36d4c-d880-49fb-a04b-556351e06dc0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:44.653815 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-08e36d4c-d880-49fb-a04b-556351e06dc0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.168186 Nov 11 20:46:44.654376 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 738/1340] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:44 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:45.671457 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fba75b1e-f7a5-44b3-8d0e-713fb26cd6c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:45.672163 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fba75b1e-f7a5-44b3-8d0e-713fb26cd6c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:45.678955 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fba75b1e-f7a5-44b3-8d0e-713fb26cd6c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:45.679410 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fba75b1e-f7a5-44b3-8d0e-713fb26cd6c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:45.680231 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fba75b1e-f7a5-44b3-8d0e-713fb26cd6c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:45.680746 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fba75b1e-f7a5-44b3-8d0e-713fb26cd6c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:45.818198 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fba75b1e-f7a5-44b3-8d0e-713fb26cd6c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:45.826414 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fba75b1e-f7a5-44b3-8d0e-713fb26cd6c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:45.827915 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-fba75b1e-f7a5-44b3-8d0e-713fb26cd6c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:45.829107 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fba75b1e-f7a5-44b3-8d0e-713fb26cd6c0 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.161554 Nov 11 20:46:45.829677 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 739/1341] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:45 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:46.848463 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-12899333-d978-4800-b71e-593b9f587d63 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:46.849152 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-12899333-d978-4800-b71e-593b9f587d63 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:46.855257 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-12899333-d978-4800-b71e-593b9f587d63 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:46.855700 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-12899333-d978-4800-b71e-593b9f587d63 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:46.856502 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-12899333-d978-4800-b71e-593b9f587d63 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:46.856933 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-12899333-d978-4800-b71e-593b9f587d63 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:47.007076 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-12899333-d978-4800-b71e-593b9f587d63 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:47.014639 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-12899333-d978-4800-b71e-593b9f587d63 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:47.016146 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-12899333-d978-4800-b71e-593b9f587d63 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:47.017282 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-12899333-d978-4800-b71e-593b9f587d63 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.173183 Nov 11 20:46:47.017826 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 740/1342] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:46 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:48.035174 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-95927f63-9776-459a-821b-9a08f7b30e5b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:48.036035 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-95927f63-9776-459a-821b-9a08f7b30e5b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:48.042301 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-95927f63-9776-459a-821b-9a08f7b30e5b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:48.042755 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-95927f63-9776-459a-821b-9a08f7b30e5b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:48.043555 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-95927f63-9776-459a-821b-9a08f7b30e5b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:48.044019 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-95927f63-9776-459a-821b-9a08f7b30e5b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:48.193822 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-95927f63-9776-459a-821b-9a08f7b30e5b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:48.202767 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-95927f63-9776-459a-821b-9a08f7b30e5b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:48.204403 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-95927f63-9776-459a-821b-9a08f7b30e5b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:48.205647 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-95927f63-9776-459a-821b-9a08f7b30e5b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.174879 Nov 11 20:46:48.206826 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 741/1343] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:48 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:49.225102 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c58acf0e-a117-4209-ad79-c5a61978a2a7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:49.225770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c58acf0e-a117-4209-ad79-c5a61978a2a7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:49.232347 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c58acf0e-a117-4209-ad79-c5a61978a2a7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:49.232784 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c58acf0e-a117-4209-ad79-c5a61978a2a7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:49.233571 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c58acf0e-a117-4209-ad79-c5a61978a2a7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:49.234004 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c58acf0e-a117-4209-ad79-c5a61978a2a7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:49.372391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c58acf0e-a117-4209-ad79-c5a61978a2a7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:49.381480 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c58acf0e-a117-4209-ad79-c5a61978a2a7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:49.382974 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c58acf0e-a117-4209-ad79-c5a61978a2a7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:49.384188 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c58acf0e-a117-4209-ad79-c5a61978a2a7 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.163568 Nov 11 20:46:49.384749 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 742/1344] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:49 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:50.402773 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3219b200-7827-4001-a579-de6dd3d39b48 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:50.403485 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3219b200-7827-4001-a579-de6dd3d39b48 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:50.410235 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3219b200-7827-4001-a579-de6dd3d39b48 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:50.410703 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3219b200-7827-4001-a579-de6dd3d39b48 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:50.411495 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3219b200-7827-4001-a579-de6dd3d39b48 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:50.411934 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3219b200-7827-4001-a579-de6dd3d39b48 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:50.549473 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3219b200-7827-4001-a579-de6dd3d39b48 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:50.562258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3219b200-7827-4001-a579-de6dd3d39b48 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:50.563772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3219b200-7827-4001-a579-de6dd3d39b48 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:50.564948 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3219b200-7827-4001-a579-de6dd3d39b48 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.166226 Nov 11 20:46:50.565686 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 743/1345] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:50 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:51.583195 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-04d650e6-04af-4ad2-b364-c46343bd7d32 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:51.583801 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-04d650e6-04af-4ad2-b364-c46343bd7d32 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:51.590271 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-04d650e6-04af-4ad2-b364-c46343bd7d32 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:51.590922 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-04d650e6-04af-4ad2-b364-c46343bd7d32 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:51.591893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-04d650e6-04af-4ad2-b364-c46343bd7d32 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:51.592636 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-04d650e6-04af-4ad2-b364-c46343bd7d32 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:51.730433 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-04d650e6-04af-4ad2-b364-c46343bd7d32 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:51.738781 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-04d650e6-04af-4ad2-b364-c46343bd7d32 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:51.740394 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-04d650e6-04af-4ad2-b364-c46343bd7d32 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:51.741823 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-04d650e6-04af-4ad2-b364-c46343bd7d32 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.163007 Nov 11 20:46:51.742393 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 744/1346] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:51 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:52.761238 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d939dec9-2aa0-4d8a-b865-edbaf8826238 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:52.761238 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d939dec9-2aa0-4d8a-b865-edbaf8826238 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:52.767826 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d939dec9-2aa0-4d8a-b865-edbaf8826238 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:52.768305 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d939dec9-2aa0-4d8a-b865-edbaf8826238 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:52.769949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d939dec9-2aa0-4d8a-b865-edbaf8826238 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:52.770901 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d939dec9-2aa0-4d8a-b865-edbaf8826238 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:52.978938 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d939dec9-2aa0-4d8a-b865-edbaf8826238 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:52.988175 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d939dec9-2aa0-4d8a-b865-edbaf8826238 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:52.990018 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d939dec9-2aa0-4d8a-b865-edbaf8826238 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:52.991896 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d939dec9-2aa0-4d8a-b865-edbaf8826238 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.234757 Nov 11 20:46:52.992582 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 745/1347] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:52 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:54.016051 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cd823dd9-d7db-440b-b297-9060e7c7eb3a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:54.016723 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cd823dd9-d7db-440b-b297-9060e7c7eb3a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:54.024659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cd823dd9-d7db-440b-b297-9060e7c7eb3a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:54.025106 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cd823dd9-d7db-440b-b297-9060e7c7eb3a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:54.025907 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cd823dd9-d7db-440b-b297-9060e7c7eb3a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:54.026340 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cd823dd9-d7db-440b-b297-9060e7c7eb3a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:54.177964 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cd823dd9-d7db-440b-b297-9060e7c7eb3a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:54.187113 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cd823dd9-d7db-440b-b297-9060e7c7eb3a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:54.188712 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cd823dd9-d7db-440b-b297-9060e7c7eb3a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:54.189943 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cd823dd9-d7db-440b-b297-9060e7c7eb3a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.177743 Nov 11 20:46:54.191364 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 746/1348] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:54 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:55.208759 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f5d1a20a-247a-482c-8a83-ef2fab6c4d31 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:55.209439 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f5d1a20a-247a-482c-8a83-ef2fab6c4d31 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:55.215846 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f5d1a20a-247a-482c-8a83-ef2fab6c4d31 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:55.216318 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f5d1a20a-247a-482c-8a83-ef2fab6c4d31 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:55.217105 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f5d1a20a-247a-482c-8a83-ef2fab6c4d31 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:55.217790 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f5d1a20a-247a-482c-8a83-ef2fab6c4d31 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:55.362974 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f5d1a20a-247a-482c-8a83-ef2fab6c4d31 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:55.371244 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f5d1a20a-247a-482c-8a83-ef2fab6c4d31 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:55.372759 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-f5d1a20a-247a-482c-8a83-ef2fab6c4d31 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:55.373908 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f5d1a20a-247a-482c-8a83-ef2fab6c4d31 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.169105 Nov 11 20:46:55.374466 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 747/1349] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:55 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:56.392200 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ecd3ad11-debe-4fa8-b4e9-98ce0bb4534a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:56.392889 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ecd3ad11-debe-4fa8-b4e9-98ce0bb4534a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:56.399434 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ecd3ad11-debe-4fa8-b4e9-98ce0bb4534a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:56.399877 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ecd3ad11-debe-4fa8-b4e9-98ce0bb4534a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:56.400795 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ecd3ad11-debe-4fa8-b4e9-98ce0bb4534a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:56.401208 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ecd3ad11-debe-4fa8-b4e9-98ce0bb4534a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:56.536353 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ecd3ad11-debe-4fa8-b4e9-98ce0bb4534a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:56.544451 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ecd3ad11-debe-4fa8-b4e9-98ce0bb4534a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:56.545948 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-ecd3ad11-debe-4fa8-b4e9-98ce0bb4534a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:56.547108 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ecd3ad11-debe-4fa8-b4e9-98ce0bb4534a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.158650 Nov 11 20:46:56.547668 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 748/1350] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:56 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:57.568438 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e0193481-465e-4293-ad04-c2c7002b6fae tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:57.569134 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e0193481-465e-4293-ad04-c2c7002b6fae tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:57.576301 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e0193481-465e-4293-ad04-c2c7002b6fae tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:57.576877 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e0193481-465e-4293-ad04-c2c7002b6fae tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:57.577934 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e0193481-465e-4293-ad04-c2c7002b6fae tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:57.578386 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e0193481-465e-4293-ad04-c2c7002b6fae tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:57.724260 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e0193481-465e-4293-ad04-c2c7002b6fae tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:57.732575 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e0193481-465e-4293-ad04-c2c7002b6fae tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:57.734227 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e0193481-465e-4293-ad04-c2c7002b6fae tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:57.735521 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e0193481-465e-4293-ad04-c2c7002b6fae tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.173452 Nov 11 20:46:57.736116 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 749/1351] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:57 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:58.757149 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-672ed61d-6151-4e2d-ab71-b3621dbb6ad5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:58.757830 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-672ed61d-6151-4e2d-ab71-b3621dbb6ad5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:58.764981 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-672ed61d-6151-4e2d-ab71-b3621dbb6ad5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:58.765433 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-672ed61d-6151-4e2d-ab71-b3621dbb6ad5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:58.766230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-672ed61d-6151-4e2d-ab71-b3621dbb6ad5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:58.766697 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-672ed61d-6151-4e2d-ab71-b3621dbb6ad5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:58.800625 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8b8a8698-8fc6-456e-a94a-1b7d669b8e2b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 30805 microversion: 2.1 time: 15.314353 Nov 11 20:46:58.802205 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 603/1352] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:43 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 30805 bytes in 15318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:46:58.903774 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-672ed61d-6151-4e2d-ab71-b3621dbb6ad5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:58.912119 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-672ed61d-6151-4e2d-ab71-b3621dbb6ad5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:58.913759 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-672ed61d-6151-4e2d-ab71-b3621dbb6ad5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:46:58.914903 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-672ed61d-6151-4e2d-ab71-b3621dbb6ad5 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.161786 Nov 11 20:46:58.915459 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 750/1353] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:58 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:46:59.813714 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a16cd629-9f60-4a9f-b2b8-480bf6e38a35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:46:59.814707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a16cd629-9f60-4a9f-b2b8-480bf6e38a35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:59.822481 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a16cd629-9f60-4a9f-b2b8-480bf6e38a35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:59.822927 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a16cd629-9f60-4a9f-b2b8-480bf6e38a35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:59.823703 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a16cd629-9f60-4a9f-b2b8-480bf6e38a35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:59.824166 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a16cd629-9f60-4a9f-b2b8-480bf6e38a35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:59.933635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-90ca29b3-a300-414a-8a8b-e46e9e077172 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:46:59.934228 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-90ca29b3-a300-414a-8a8b-e46e9e077172 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:46:59.940884 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90ca29b3-a300-414a-8a8b-e46e9e077172 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:59.941328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90ca29b3-a300-414a-8a8b-e46e9e077172 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:46:59.942114 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90ca29b3-a300-414a-8a8b-e46e9e077172 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:46:59.942543 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-90ca29b3-a300-414a-8a8b-e46e9e077172 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:00.079790 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-90ca29b3-a300-414a-8a8b-e46e9e077172 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:00.083156 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a16cd629-9f60-4a9f-b2b8-480bf6e38a35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 31927 microversion: 2.1 time: 0.273343 Nov 11 20:47:00.085022 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 604/1354] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:46:59 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 31927 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:47:00.087883 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-90ca29b3-a300-414a-8a8b-e46e9e077172 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:00.089393 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-90ca29b3-a300-414a-8a8b-e46e9e077172 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:00.090543 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-90ca29b3-a300-414a-8a8b-e46e9e077172 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.160755 Nov 11 20:47:00.091085 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 751/1355] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:46:59 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:47:01.096512 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7e967ced-10b8-4895-9852-f2cd8dd2b3ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:01.097515 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7e967ced-10b8-4895-9852-f2cd8dd2b3ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:01.104977 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7e967ced-10b8-4895-9852-f2cd8dd2b3ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:01.105426 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7e967ced-10b8-4895-9852-f2cd8dd2b3ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:01.106219 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7e967ced-10b8-4895-9852-f2cd8dd2b3ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:01.106654 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7e967ced-10b8-4895-9852-f2cd8dd2b3ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:01.110391 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5aa189ff-db56-4b05-9258-6d7a5d40cd46 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:01.111121 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5aa189ff-db56-4b05-9258-6d7a5d40cd46 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:01.117930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5aa189ff-db56-4b05-9258-6d7a5d40cd46 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:01.118375 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5aa189ff-db56-4b05-9258-6d7a5d40cd46 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:01.119156 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5aa189ff-db56-4b05-9258-6d7a5d40cd46 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:01.119586 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5aa189ff-db56-4b05-9258-6d7a5d40cd46 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:01.214222 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7e967ced-10b8-4895-9852-f2cd8dd2b3ab tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 33006 microversion: 2.1 time: 0.121784 Nov 11 20:47:01.214893 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 605/1356] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:47:01 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 33006 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 11 20:47:01.259651 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5aa189ff-db56-4b05-9258-6d7a5d40cd46 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:01.267466 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5aa189ff-db56-4b05-9258-6d7a5d40cd46 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:01.268992 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5aa189ff-db56-4b05-9258-6d7a5d40cd46 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:01.270145 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5aa189ff-db56-4b05-9258-6d7a5d40cd46 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.164437 Nov 11 20:47:01.270710 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 752/1357] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:47:01 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:47:02.229535 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4c9304e0-5127-4275-9bfb-f96ee7f1ef2c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:02.230479 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4c9304e0-5127-4275-9bfb-f96ee7f1ef2c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:02.237577 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4c9304e0-5127-4275-9bfb-f96ee7f1ef2c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:02.238031 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4c9304e0-5127-4275-9bfb-f96ee7f1ef2c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:02.238818 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4c9304e0-5127-4275-9bfb-f96ee7f1ef2c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:02.239253 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4c9304e0-5127-4275-9bfb-f96ee7f1ef2c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:02.289564 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3aa698e7-23f3-4284-b73f-5aae1612c277 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:02.291015 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3aa698e7-23f3-4284-b73f-5aae1612c277 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:02.297364 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3aa698e7-23f3-4284-b73f-5aae1612c277 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:02.297808 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3aa698e7-23f3-4284-b73f-5aae1612c277 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:02.298592 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3aa698e7-23f3-4284-b73f-5aae1612c277 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:02.299023 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3aa698e7-23f3-4284-b73f-5aae1612c277 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:02.340334 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4c9304e0-5127-4275-9bfb-f96ee7f1ef2c tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 33599 microversion: 2.1 time: 0.115525 Nov 11 20:47:02.340972 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 606/1358] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:47:02 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 33599 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:47:02.437070 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3aa698e7-23f3-4284-b73f-5aae1612c277 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:02.444893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3aa698e7-23f3-4284-b73f-5aae1612c277 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:02.447027 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-3aa698e7-23f3-4284-b73f-5aae1612c277 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:02.448233 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3aa698e7-23f3-4284-b73f-5aae1612c277 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.162752 Nov 11 20:47:02.448801 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 753/1359] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:47:02 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:47:03.352979 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-942ec183-94e9-4a95-b5cd-a00f4b0351ad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:03.353975 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-942ec183-94e9-4a95-b5cd-a00f4b0351ad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:03.360770 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-942ec183-94e9-4a95-b5cd-a00f4b0351ad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:03.361220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-942ec183-94e9-4a95-b5cd-a00f4b0351ad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:03.362226 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-942ec183-94e9-4a95-b5cd-a00f4b0351ad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:03.362680 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-942ec183-94e9-4a95-b5cd-a00f4b0351ad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:03.466635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-58521ec8-2280-4398-8662-e9b5056d0b83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:03.467388 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-58521ec8-2280-4398-8662-e9b5056d0b83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:03.474057 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-58521ec8-2280-4398-8662-e9b5056d0b83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:03.474496 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-58521ec8-2280-4398-8662-e9b5056d0b83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:03.475281 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-58521ec8-2280-4398-8662-e9b5056d0b83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:03.475714 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-58521ec8-2280-4398-8662-e9b5056d0b83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:03.477595 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-942ec183-94e9-4a95-b5cd-a00f4b0351ad tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 34176 microversion: 2.1 time: 0.128503 Nov 11 20:47:03.478396 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 607/1360] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:47:03 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 34176 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:47:03.613683 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-58521ec8-2280-4398-8662-e9b5056d0b83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:03.621931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-58521ec8-2280-4398-8662-e9b5056d0b83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:03.623409 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-58521ec8-2280-4398-8662-e9b5056d0b83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:03.624699 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-58521ec8-2280-4398-8662-e9b5056d0b83 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.161825 Nov 11 20:47:03.625259 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 754/1361] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:47:03 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:47:04.490658 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5e07d360-d63a-4b84-b51f-aa39aa7a63fa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:04.491660 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5e07d360-d63a-4b84-b51f-aa39aa7a63fa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:04.498751 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5e07d360-d63a-4b84-b51f-aa39aa7a63fa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:04.499194 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5e07d360-d63a-4b84-b51f-aa39aa7a63fa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:04.499992 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5e07d360-d63a-4b84-b51f-aa39aa7a63fa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:04.500420 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5e07d360-d63a-4b84-b51f-aa39aa7a63fa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:04.608274 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5e07d360-d63a-4b84-b51f-aa39aa7a63fa tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 34831 microversion: 2.1 time: 0.121759 Nov 11 20:47:04.609223 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 608/1362] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:47:04 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 34831 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:47:04.643504 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d9f59bf5-b2c7-49ec-bbd7-1ef408723c59 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:04.644093 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d9f59bf5-b2c7-49ec-bbd7-1ef408723c59 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:04.651092 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d9f59bf5-b2c7-49ec-bbd7-1ef408723c59 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:04.651530 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d9f59bf5-b2c7-49ec-bbd7-1ef408723c59 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:04.652337 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d9f59bf5-b2c7-49ec-bbd7-1ef408723c59 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:04.652770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d9f59bf5-b2c7-49ec-bbd7-1ef408723c59 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:04.786991 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d9f59bf5-b2c7-49ec-bbd7-1ef408723c59 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:04.798305 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d9f59bf5-b2c7-49ec-bbd7-1ef408723c59 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:04.799793 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d9f59bf5-b2c7-49ec-bbd7-1ef408723c59 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:04.801014 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d9f59bf5-b2c7-49ec-bbd7-1ef408723c59 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.161279 Nov 11 20:47:04.802271 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 755/1363] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:47:04 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:47:04.905079 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-5356095f-86f9-49b4-bb20-73cfef6e766f req-3522ef9f-f406-4f2c-af99-5ef69865f15a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e", "name": "network-vif-plugged", "status": "completed", "tag": "962e998a-c58f-4876-b93f-8de3af37c538"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:04.906485 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:47:04.906485 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:47:04.916322 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-5356095f-86f9-49b4-bb20-73cfef6e766f req-3522ef9f-f406-4f2c-af99-5ef69865f15a service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:04.916791 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-5356095f-86f9-49b4-bb20-73cfef6e766f req-3522ef9f-f406-4f2c-af99-5ef69865f15a service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:04.928639 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-5356095f-86f9-49b4-bb20-73cfef6e766f req-3522ef9f-f406-4f2c-af99-5ef69865f15a service nova] Creating event network-vif-plugged:962e998a-c58f-4876-b93f-8de3af37c538 for instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e on hv-cinder-81764 Nov 11 20:47:04.934649 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-5356095f-86f9-49b4-bb20-73cfef6e766f req-3522ef9f-f406-4f2c-af99-5ef69865f15a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033493 Nov 11 20:47:04.935292 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 609/1364] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:47:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:05.619728 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-89437b73-accd-4ea2-bf6f-dee0cbfc9865 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:05.620867 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-89437b73-accd-4ea2-bf6f-dee0cbfc9865 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:05.627171 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-89437b73-accd-4ea2-bf6f-dee0cbfc9865 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:05.627612 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-89437b73-accd-4ea2-bf6f-dee0cbfc9865 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:05.628427 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-89437b73-accd-4ea2-bf6f-dee0cbfc9865 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:05.628850 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-89437b73-accd-4ea2-bf6f-dee0cbfc9865 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:05.740336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-89437b73-accd-4ea2-bf6f-dee0cbfc9865 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 35493 microversion: 2.1 time: 0.124173 Nov 11 20:47:05.741006 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 756/1365] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:47:05 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 35493 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:47:05.821522 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3c96fab4-2a16-4037-88e5-f5d1f444d1ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:05.822275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3c96fab4-2a16-4037-88e5-f5d1f444d1ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:05.828371 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3c96fab4-2a16-4037-88e5-f5d1f444d1ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:05.828818 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3c96fab4-2a16-4037-88e5-f5d1f444d1ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:05.829594 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3c96fab4-2a16-4037-88e5-f5d1f444d1ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:05.830028 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3c96fab4-2a16-4037-88e5-f5d1f444d1ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:05.964687 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3c96fab4-2a16-4037-88e5-f5d1f444d1ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:05.973269 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3c96fab4-2a16-4037-88e5-f5d1f444d1ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:05.974749 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3c96fab4-2a16-4037-88e5-f5d1f444d1ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:05.975895 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3c96fab4-2a16-4037-88e5-f5d1f444d1ee tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.159770 Nov 11 20:47:05.976467 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 610/1366] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:47:05 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:47:06.753150 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2fdedd73-f377-48e4-b9c6-c8b9ac727cd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:06.754062 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2fdedd73-f377-48e4-b9c6-c8b9ac727cd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:06.760969 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2fdedd73-f377-48e4-b9c6-c8b9ac727cd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:06.761415 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2fdedd73-f377-48e4-b9c6-c8b9ac727cd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:06.762199 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2fdedd73-f377-48e4-b9c6-c8b9ac727cd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:06.762633 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2fdedd73-f377-48e4-b9c6-c8b9ac727cd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:06.858461 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2fdedd73-f377-48e4-b9c6-c8b9ac727cd8 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 36255 microversion: 2.1 time: 0.109119 Nov 11 20:47:06.859589 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 757/1367] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:47:06 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 36255 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:47:06.994982 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-02649376-b32c-4b0a-bfd7-a6d22a0d0a87 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:06.995734 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-02649376-b32c-4b0a-bfd7-a6d22a0d0a87 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:07.002171 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-02649376-b32c-4b0a-bfd7-a6d22a0d0a87 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:07.002615 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-02649376-b32c-4b0a-bfd7-a6d22a0d0a87 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:07.003447 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-02649376-b32c-4b0a-bfd7-a6d22a0d0a87 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:07.003830 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-02649376-b32c-4b0a-bfd7-a6d22a0d0a87 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:07.142939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-02649376-b32c-4b0a-bfd7-a6d22a0d0a87 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:07.152243 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-02649376-b32c-4b0a-bfd7-a6d22a0d0a87 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:07.153928 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-02649376-b32c-4b0a-bfd7-a6d22a0d0a87 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:07.155184 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-02649376-b32c-4b0a-bfd7-a6d22a0d0a87 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1729 microversion: 2.20 time: 0.164695 Nov 11 20:47:07.155696 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 611/1368] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:47:06 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:47:07.871428 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-712c00c7-9ec0-4507-ba78-2612f6d584ee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:07.872463 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-712c00c7-9ec0-4507-ba78-2612f6d584ee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:07.879515 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-712c00c7-9ec0-4507-ba78-2612f6d584ee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:07.880050 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-712c00c7-9ec0-4507-ba78-2612f6d584ee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:07.880851 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-712c00c7-9ec0-4507-ba78-2612f6d584ee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:07.881308 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-712c00c7-9ec0-4507-ba78-2612f6d584ee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:07.981195 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-712c00c7-9ec0-4507-ba78-2612f6d584ee tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 36938 microversion: 2.1 time: 0.113913 Nov 11 20:47:07.981877 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 758/1369] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:47:07 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 36938 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:47:08.174289 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a69e6355-1313-45eb-92ed-34b2b4da0ce6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:08.174906 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a69e6355-1313-45eb-92ed-34b2b4da0ce6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:08.181751 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a69e6355-1313-45eb-92ed-34b2b4da0ce6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:08.183861 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a69e6355-1313-45eb-92ed-34b2b4da0ce6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:08.184656 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a69e6355-1313-45eb-92ed-34b2b4da0ce6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:08.185111 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a69e6355-1313-45eb-92ed-34b2b4da0ce6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:08.318171 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a69e6355-1313-45eb-92ed-34b2b4da0ce6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:08.326698 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a69e6355-1313-45eb-92ed-34b2b4da0ce6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:08.328226 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a69e6355-1313-45eb-92ed-34b2b4da0ce6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:08.329366 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a69e6355-1313-45eb-92ed-34b2b4da0ce6 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1716 microversion: 2.20 time: 0.158915 Nov 11 20:47:08.329924 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 612/1370] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:47:08 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:47:08.994247 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d2405ead-281b-4461-8773-d6c413f344d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:08.995258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d2405ead-281b-4461-8773-d6c413f344d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:09.002751 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d2405ead-281b-4461-8773-d6c413f344d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:09.003204 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d2405ead-281b-4461-8773-d6c413f344d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:09.004011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d2405ead-281b-4461-8773-d6c413f344d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:09.004448 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d2405ead-281b-4461-8773-d6c413f344d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:09.108733 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d2405ead-281b-4461-8773-d6c413f344d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 37976 microversion: 2.1 time: 0.119048 Nov 11 20:47:09.109640 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 759/1371] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:47:08 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 37976 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:47:10.120920 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d4341035-d6b0-492c-b14b-96ad1f5c64c4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:10.121889 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d4341035-d6b0-492c-b14b-96ad1f5c64c4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:10.128168 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d4341035-d6b0-492c-b14b-96ad1f5c64c4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:10.128621 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d4341035-d6b0-492c-b14b-96ad1f5c64c4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:10.129404 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d4341035-d6b0-492c-b14b-96ad1f5c64c4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:10.129829 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d4341035-d6b0-492c-b14b-96ad1f5c64c4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:10.227716 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d4341035-d6b0-492c-b14b-96ad1f5c64c4 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 38216 microversion: 2.1 time: 0.110619 Nov 11 20:47:10.228662 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 613/1372] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:47:10 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 38216 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:47:11.240518 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-00334511-4bf7-4ca9-99a5-0a10b87fd267 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:11.241514 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-00334511-4bf7-4ca9-99a5-0a10b87fd267 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:11.248703 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-00334511-4bf7-4ca9-99a5-0a10b87fd267 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:11.249211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-00334511-4bf7-4ca9-99a5-0a10b87fd267 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:11.249938 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-00334511-4bf7-4ca9-99a5-0a10b87fd267 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:11.250372 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-00334511-4bf7-4ca9-99a5-0a10b87fd267 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:11.357189 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-00334511-4bf7-4ca9-99a5-0a10b87fd267 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 38220 microversion: 2.1 time: 0.120628 Nov 11 20:47:11.357858 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 760/1373] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:47:11 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 38220 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:47:12.370304 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-07137bdb-2121-4174-a893-159aadcb5e9e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:12.371293 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-07137bdb-2121-4174-a893-159aadcb5e9e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:12.378106 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-07137bdb-2121-4174-a893-159aadcb5e9e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:12.378546 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-07137bdb-2121-4174-a893-159aadcb5e9e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:12.379313 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-07137bdb-2121-4174-a893-159aadcb5e9e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:12.379742 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-07137bdb-2121-4174-a893-159aadcb5e9e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:12.458939 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-07137bdb-2121-4174-a893-159aadcb5e9e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action" status: 200 len: 38345 microversion: 2.1 time: 0.093118 Nov 11 20:47:12.459565 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 614/1374] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:47:12 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/action => generated 38345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 11 20:47:12.470786 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-11225811-5b7c-4325-9053-d1d7c8c3bc4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:12.471396 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-11225811-5b7c-4325-9053-d1d7c8c3bc4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:12.479243 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11225811-5b7c-4325-9053-d1d7c8c3bc4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:12.479687 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11225811-5b7c-4325-9053-d1d7c8c3bc4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:12.480507 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11225811-5b7c-4325-9053-d1d7c8c3bc4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:12.480949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-11225811-5b7c-4325-9053-d1d7c8c3bc4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:12.504493 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-11225811-5b7c-4325-9053-d1d7c8c3bc4e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/ips" status: 200 len: 144 microversion: 2.1 time: 0.037997 Nov 11 20:47:12.505070 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 761/1375] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Nov 11 20:47:12 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:13.810916 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3312265b-2dfc-4790-9836-b47a332d301a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff9264e0-9676-4b4c-a910-1605083045a7"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:13.812065 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3312265b-2dfc-4790-9836-b47a332d301a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:13.818755 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3312265b-2dfc-4790-9836-b47a332d301a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:13.819198 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3312265b-2dfc-4790-9836-b47a332d301a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:13.819965 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3312265b-2dfc-4790-9836-b47a332d301a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:13.820475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3312265b-2dfc-4790-9836-b47a332d301a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:14.065311 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3312265b-2dfc-4790-9836-b47a332d301a tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258282 Nov 11 20:47:14.065907 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 615/1376] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:47:13 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:21.531787 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b0b2cc34-1d12-4bbf-9dda-1e0732361afe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:21.532720 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b0b2cc34-1d12-4bbf-9dda-1e0732361afe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:21.538868 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0b2cc34-1d12-4bbf-9dda-1e0732361afe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:21.539309 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0b2cc34-1d12-4bbf-9dda-1e0732361afe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:21.540103 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0b2cc34-1d12-4bbf-9dda-1e0732361afe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:21.540749 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b0b2cc34-1d12-4bbf-9dda-1e0732361afe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:21.569323 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b0b2cc34-1d12-4bbf-9dda-1e0732361afe tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041272 Nov 11 20:47:21.569859 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 762/1377] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:47:21 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:21.581213 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9e9cc357-2fd8-4663-b194-5b1d3a2e62c5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:21.581839 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9e9cc357-2fd8-4663-b194-5b1d3a2e62c5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:21.588156 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9e9cc357-2fd8-4663-b194-5b1d3a2e62c5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:21.588609 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9e9cc357-2fd8-4663-b194-5b1d3a2e62c5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:21.589391 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9e9cc357-2fd8-4663-b194-5b1d3a2e62c5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:21.589831 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9e9cc357-2fd8-4663-b194-5b1d3a2e62c5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:21.617409 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9e9cc357-2fd8-4663-b194-5b1d3a2e62c5 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments/ff9264e0-9676-4b4c-a910-1605083045a7" status: 200 len: 194 microversion: 2.1 time: 0.040892 Nov 11 20:47:21.617975 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 616/1378] 10.222.0.61 () {58 vars in 1412 bytes} [Thu Nov 11 20:47:21 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments/ff9264e0-9676-4b4c-a910-1605083045a7 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:22.920792 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-85309dc3-1d96-4bee-b7fa-c631df8b5498 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f9a7c34-c510-4a99-9ade-c584411d0147"}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:22.921868 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-85309dc3-1d96-4bee-b7fa-c631df8b5498 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:22.928140 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-85309dc3-1d96-4bee-b7fa-c631df8b5498 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:22.928598 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-85309dc3-1d96-4bee-b7fa-c631df8b5498 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:22.929374 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-85309dc3-1d96-4bee-b7fa-c631df8b5498 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:22.929808 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-85309dc3-1d96-4bee-b7fa-c631df8b5498 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:23.180699 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-85309dc3-1d96-4bee-b7fa-c631df8b5498 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263454 Nov 11 20:47:23.182417 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 763/1379] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Nov 11 20:47:22 2021] POST /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:30.642988 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-7dfb3172-6c6d-47c2-92d3-a96176b131ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:30.643986 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-7dfb3172-6c6d-47c2-92d3-a96176b131ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:30.651400 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7dfb3172-6c6d-47c2-92d3-a96176b131ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:30.651850 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7dfb3172-6c6d-47c2-92d3-a96176b131ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:30.652667 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7dfb3172-6c6d-47c2-92d3-a96176b131ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:30.653101 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-7dfb3172-6c6d-47c2-92d3-a96176b131ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:30.682715 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-7dfb3172-6c6d-47c2-92d3-a96176b131ed tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043476 Nov 11 20:47:30.683266 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 617/1380] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:47:30 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:30.979246 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3465ec6f-6dcc-4f86-8f4f-d2b1438a0f35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:30.979823 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-3465ec6f-6dcc-4f86-8f4f-d2b1438a0f35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:30.985997 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3465ec6f-6dcc-4f86-8f4f-d2b1438a0f35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:30.986444 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3465ec6f-6dcc-4f86-8f4f-d2b1438a0f35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:30.987229 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3465ec6f-6dcc-4f86-8f4f-d2b1438a0f35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:30.987657 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-3465ec6f-6dcc-4f86-8f4f-d2b1438a0f35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:31.016313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3465ec6f-6dcc-4f86-8f4f-d2b1438a0f35 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments/ff9264e0-9676-4b4c-a910-1605083045a7" status: 200 len: 194 microversion: 2.1 time: 0.041813 Nov 11 20:47:31.016903 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 764/1381] 10.222.0.61 () {58 vars in 1412 bytes} [Thu Nov 11 20:47:30 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments/ff9264e0-9676-4b4c-a910-1605083045a7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:31.026842 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2f75aef2-9716-4b16-a211-533333141541 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:31.027404 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2f75aef2-9716-4b16-a211-533333141541 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:31.033530 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f75aef2-9716-4b16-a211-533333141541 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:31.033970 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f75aef2-9716-4b16-a211-533333141541 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:31.034736 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f75aef2-9716-4b16-a211-533333141541 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:31.035167 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2f75aef2-9716-4b16-a211-533333141541 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:31.111825 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.objects.instance [None req-2f75aef2-9716-4b16-a211-533333141541 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lazy-loading 'services' on Instance uuid 971ec047-d7f9-4d3c-92e7-c7c532ece303 {{(pid=122527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:47:31.180176 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2f75aef2-9716-4b16-a211-533333141541 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "DELETE /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments/ff9264e0-9676-4b4c-a910-1605083045a7" status: 202 len: 0 microversion: 2.1 time: 0.157213 Nov 11 20:47:31.180734 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 618/1382] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Nov 11 20:47:31 2021] DELETE /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments/ff9264e0-9676-4b4c-a910-1605083045a7 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:47:33.336381 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6abc81f1-c060-4506-903f-1cbd219898b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:33.336906 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-6abc81f1-c060-4506-903f-1cbd219898b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:33.343479 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6abc81f1-c060-4506-903f-1cbd219898b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:33.343949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6abc81f1-c060-4506-903f-1cbd219898b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:33.345073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6abc81f1-c060-4506-903f-1cbd219898b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:33.345515 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-6abc81f1-c060-4506-903f-1cbd219898b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:33.375323 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6abc81f1-c060-4506-903f-1cbd219898b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments/3f9a7c34-c510-4a99-9ade-c584411d0147" status: 200 len: 194 microversion: 2.1 time: 0.042578 Nov 11 20:47:33.375940 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 765/1383] 10.222.0.61 () {58 vars in 1412 bytes} [Thu Nov 11 20:47:33 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments/3f9a7c34-c510-4a99-9ade-c584411d0147 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:33.386518 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-868f7bb2-2124-4f7e-8217-476b64cba67b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:33.387096 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-868f7bb2-2124-4f7e-8217-476b64cba67b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:33.393283 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-868f7bb2-2124-4f7e-8217-476b64cba67b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:33.393739 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-868f7bb2-2124-4f7e-8217-476b64cba67b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:33.394533 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-868f7bb2-2124-4f7e-8217-476b64cba67b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:33.394971 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-868f7bb2-2124-4f7e-8217-476b64cba67b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:33.474462 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.objects.instance [None req-868f7bb2-2124-4f7e-8217-476b64cba67b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lazy-loading 'services' on Instance uuid 971ec047-d7f9-4d3c-92e7-c7c532ece303 {{(pid=122527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:47:33.543172 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-868f7bb2-2124-4f7e-8217-476b64cba67b tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "DELETE /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments/3f9a7c34-c510-4a99-9ade-c584411d0147" status: 202 len: 0 microversion: 2.1 time: 0.161104 Nov 11 20:47:33.543678 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 619/1384] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Nov 11 20:47:33 2021] DELETE /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments/3f9a7c34-c510-4a99-9ade-c584411d0147 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:47:34.692499 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ee834d61-5e83-4d4c-ba28-ede08cd8bc62 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:34.693495 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ee834d61-5e83-4d4c-ba28-ede08cd8bc62 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:34.700653 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ee834d61-5e83-4d4c-ba28-ede08cd8bc62 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:34.701056 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ee834d61-5e83-4d4c-ba28-ede08cd8bc62 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:34.701826 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ee834d61-5e83-4d4c-ba28-ede08cd8bc62 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:34.702254 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ee834d61-5e83-4d4c-ba28-ede08cd8bc62 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:34.731792 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ee834d61-5e83-4d4c-ba28-ede08cd8bc62 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043004 Nov 11 20:47:34.732380 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 766/1385] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:47:34 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:47:34.835610 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5b3ff8ad-bac2-4f59-b52e-05b7aa4d1294 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:34.836631 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-5b3ff8ad-bac2-4f59-b52e-05b7aa4d1294 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:34.844043 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b3ff8ad-bac2-4f59-b52e-05b7aa4d1294 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:34.844750 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b3ff8ad-bac2-4f59-b52e-05b7aa4d1294 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:34.845534 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b3ff8ad-bac2-4f59-b52e-05b7aa4d1294 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:34.845971 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-5b3ff8ad-bac2-4f59-b52e-05b7aa4d1294 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:34.874475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5b3ff8ad-bac2-4f59-b52e-05b7aa4d1294 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043367 Nov 11 20:47:34.875021 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 620/1386] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Nov 11 20:47:34 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 11 20:47:34.929736 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ab122def-5293-416f-9294-d2cfe4bfe180 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:34.930236 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ab122def-5293-416f-9294-d2cfe4bfe180 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:34.936551 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ab122def-5293-416f-9294-d2cfe4bfe180 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:34.936997 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ab122def-5293-416f-9294-d2cfe4bfe180 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:34.937770 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ab122def-5293-416f-9294-d2cfe4bfe180 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:34.938258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-ab122def-5293-416f-9294-d2cfe4bfe180 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:34.962721 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-ab122def-5293-416f-9294-d2cfe4bfe180 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Going to try to terminate instance {{(pid=122526) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:47:35.038579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ab122def-5293-416f-9294-d2cfe4bfe180 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "DELETE /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 204 len: 0 microversion: 2.1 time: 0.112193 Nov 11 20:47:35.039884 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 767/1387] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:47:34 2021] DELETE /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:47:35.047742 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-bc8877c5-fc86-4106-9b41-6dff2b396e86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:35.048388 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-bc8877c5-fc86-4106-9b41-6dff2b396e86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:35.054644 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bc8877c5-fc86-4106-9b41-6dff2b396e86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:35.055302 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bc8877c5-fc86-4106-9b41-6dff2b396e86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:35.056106 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bc8877c5-fc86-4106-9b41-6dff2b396e86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:35.056718 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-bc8877c5-fc86-4106-9b41-6dff2b396e86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:35.190850 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-bc8877c5-fc86-4106-9b41-6dff2b396e86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:35.199322 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-bc8877c5-fc86-4106-9b41-6dff2b396e86 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1670 microversion: 2.1 time: 0.155305 Nov 11 20:47:35.199891 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 621/1388] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:35 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:47:36.217438 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-80aa8dc7-cb04-4bde-a548-df11bd0ced6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:36.218125 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-80aa8dc7-cb04-4bde-a548-df11bd0ced6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:36.226306 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-80aa8dc7-cb04-4bde-a548-df11bd0ced6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:36.226745 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-80aa8dc7-cb04-4bde-a548-df11bd0ced6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:36.227514 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-80aa8dc7-cb04-4bde-a548-df11bd0ced6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:36.227940 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-80aa8dc7-cb04-4bde-a548-df11bd0ced6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:36.367257 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-80aa8dc7-cb04-4bde-a548-df11bd0ced6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:36.375093 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-80aa8dc7-cb04-4bde-a548-df11bd0ced6e tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1670 microversion: 2.1 time: 0.162012 Nov 11 20:47:36.375657 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 768/1389] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:36 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:36.849236 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-21ccec67-6b18-4594-a430-da741b1bc66c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:36.849781 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-21ccec67-6b18-4594-a430-da741b1bc66c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:36.856315 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-21ccec67-6b18-4594-a430-da741b1bc66c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:36.856756 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-21ccec67-6b18-4594-a430-da741b1bc66c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:36.857522 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-21ccec67-6b18-4594-a430-da741b1bc66c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:36.857950 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-21ccec67-6b18-4594-a430-da741b1bc66c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:36.879851 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.objects.instance [None req-21ccec67-6b18-4594-a430-da741b1bc66c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lazy-loading 'flavor' on Instance uuid c9a4baaf-615d-4da4-b61e-5a9199179627 {{(pid=122527) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:47:36.949934 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-21ccec67-6b18-4594-a430-da741b1bc66c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "POST /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627/action" status: 202 len: 0 microversion: 2.1 time: 0.104153 Nov 11 20:47:36.950512 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 622/1390] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:47:36 2021] POST /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:47:36.958337 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-03f700ad-3580-4fef-8ff1-5e8b9c0fff55 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:36.958953 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-03f700ad-3580-4fef-8ff1-5e8b9c0fff55 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:36.966207 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-03f700ad-3580-4fef-8ff1-5e8b9c0fff55 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:36.966659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-03f700ad-3580-4fef-8ff1-5e8b9c0fff55 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:36.967449 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-03f700ad-3580-4fef-8ff1-5e8b9c0fff55 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:36.967877 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-03f700ad-3580-4fef-8ff1-5e8b9c0fff55 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:37.103630 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-03f700ad-3580-4fef-8ff1-5e8b9c0fff55 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:37.111392 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-03f700ad-3580-4fef-8ff1-5e8b9c0fff55 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.156561 Nov 11 20:47:37.111952 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 769/1391] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:36 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:37.392619 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-684f96d9-1eec-411b-9ce9-18ec843d2080 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:37.393255 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-684f96d9-1eec-411b-9ce9-18ec843d2080 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:37.399622 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-684f96d9-1eec-411b-9ce9-18ec843d2080 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:37.400142 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-684f96d9-1eec-411b-9ce9-18ec843d2080 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:37.401540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-684f96d9-1eec-411b-9ce9-18ec843d2080 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:37.401978 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-684f96d9-1eec-411b-9ce9-18ec843d2080 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:37.540265 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-684f96d9-1eec-411b-9ce9-18ec843d2080 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:37.548454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-684f96d9-1eec-411b-9ce9-18ec843d2080 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1670 microversion: 2.1 time: 0.159886 Nov 11 20:47:37.549036 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 623/1392] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:37 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:38.129469 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-124e40b1-061f-4e10-94f9-77dbb443088d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:38.130101 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-124e40b1-061f-4e10-94f9-77dbb443088d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:38.136774 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-124e40b1-061f-4e10-94f9-77dbb443088d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:38.137245 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-124e40b1-061f-4e10-94f9-77dbb443088d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:38.138025 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-124e40b1-061f-4e10-94f9-77dbb443088d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:38.138452 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-124e40b1-061f-4e10-94f9-77dbb443088d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:38.343483 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-124e40b1-061f-4e10-94f9-77dbb443088d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:38.351154 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-124e40b1-061f-4e10-94f9-77dbb443088d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.225377 Nov 11 20:47:38.351724 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 770/1393] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:38 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:38.565153 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-41536f74-e428-4a2e-b02e-64ae1efba3d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:38.565766 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-41536f74-e428-4a2e-b02e-64ae1efba3d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:38.572182 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-41536f74-e428-4a2e-b02e-64ae1efba3d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:38.572631 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-41536f74-e428-4a2e-b02e-64ae1efba3d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:38.574252 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-41536f74-e428-4a2e-b02e-64ae1efba3d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:38.574839 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-41536f74-e428-4a2e-b02e-64ae1efba3d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:38.661057 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-41536f74-e428-4a2e-b02e-64ae1efba3d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4287ba46b5a349ffbb921324d6b06555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cef6cece0f4bf49468d6d0e5b6b269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:38.668196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-41536f74-e428-4a2e-b02e-64ae1efba3d3 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 200 len: 1603 microversion: 2.1 time: 0.106642 Nov 11 20:47:38.668758 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 624/1394] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:38 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 1603 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:38.741978 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-616a58ea-5e5d-480e-a60a-bb18dd684697 req-e4dbc520-c128-4808-8516-3f60edc12cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971ec047-d7f9-4d3c-92e7-c7c532ece303", "name": "network-vif-deleted", "tag": "316dc164-e888-41c3-b683-64eb173a3731"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:38.743559 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:47:38.743559 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:47:38.750893 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-616a58ea-5e5d-480e-a60a-bb18dd684697 req-e4dbc520-c128-4808-8516-3f60edc12cfc service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:38.751335 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-616a58ea-5e5d-480e-a60a-bb18dd684697 req-e4dbc520-c128-4808-8516-3f60edc12cfc service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:38.764704 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-616a58ea-5e5d-480e-a60a-bb18dd684697 req-e4dbc520-c128-4808-8516-3f60edc12cfc service nova] Creating event network-vif-deleted:316dc164-e888-41c3-b683-64eb173a3731 for instance 971ec047-d7f9-4d3c-92e7-c7c532ece303 on hv-cinder-81764 Nov 11 20:47:38.772825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-616a58ea-5e5d-480e-a60a-bb18dd684697 req-e4dbc520-c128-4808-8516-3f60edc12cfc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033952 Nov 11 20:47:38.774139 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 771/1395] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:47:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:39.369418 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-60a3d6bf-5924-4ee4-b89d-f9fb262f3595 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:39.369418 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-60a3d6bf-5924-4ee4-b89d-f9fb262f3595 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:39.376803 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-60a3d6bf-5924-4ee4-b89d-f9fb262f3595 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:39.377257 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-60a3d6bf-5924-4ee4-b89d-f9fb262f3595 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:39.378049 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-60a3d6bf-5924-4ee4-b89d-f9fb262f3595 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:39.378482 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-60a3d6bf-5924-4ee4-b89d-f9fb262f3595 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:39.522155 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-60a3d6bf-5924-4ee4-b89d-f9fb262f3595 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:39.530653 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-60a3d6bf-5924-4ee4-b89d-f9fb262f3595 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.165664 Nov 11 20:47:39.531231 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 625/1396] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:39 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:39.686150 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c323685c-d90c-485c-86bc-fb8c6ce42d82 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:39.686827 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c323685c-d90c-485c-86bc-fb8c6ce42d82 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:39.693262 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c323685c-d90c-485c-86bc-fb8c6ce42d82 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:39.693705 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c323685c-d90c-485c-86bc-fb8c6ce42d82 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:39.694501 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c323685c-d90c-485c-86bc-fb8c6ce42d82 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:39.694985 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c323685c-d90c-485c-86bc-fb8c6ce42d82 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:39.709154 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-c323685c-d90c-485c-86bc-fb8c6ce42d82 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] HTTP exception thrown: Instance 971ec047-d7f9-4d3c-92e7-c7c532ece303 could not be found. Nov 11 20:47:39.709742 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c323685c-d90c-485c-86bc-fb8c6ce42d82 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Returning 404 to user: Instance 971ec047-d7f9-4d3c-92e7-c7c532ece303 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:47:39.710572 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c323685c-d90c-485c-86bc-fb8c6ce42d82 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 404 len: 111 microversion: 2.1 time: 0.029670 Nov 11 20:47:39.711124 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 772/1397] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:39 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:47:39.721059 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-134c8dce-8797-4716-9335-67ecee9020ca tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '.version_select at 0x7ff3f29ffee0>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:39.740976 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-134c8dce-8797-4716-9335-67ecee9020ca tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-275910436" status: 202 len: 0 microversion: 2.1 time: 0.023922 Nov 11 20:47:39.741553 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 626/1398] 10.222.0.61 () {58 vars in 1217 bytes} [Thu Nov 11 20:47:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-275910436 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:47:40.547678 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-7126b852-9384-4192-bb6d-677a79ed0cbe tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:40.548235 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-7126b852-9384-4192-bb6d-677a79ed0cbe tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:40.553933 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7126b852-9384-4192-bb6d-677a79ed0cbe tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:40.554379 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7126b852-9384-4192-bb6d-677a79ed0cbe tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:40.555150 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7126b852-9384-4192-bb6d-677a79ed0cbe tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:40.555581 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-7126b852-9384-4192-bb6d-677a79ed0cbe tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:40.698847 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-7126b852-9384-4192-bb6d-677a79ed0cbe tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:40.706506 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-7126b852-9384-4192-bb6d-677a79ed0cbe tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.162637 Nov 11 20:47:40.707064 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 773/1399] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:40 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:41.723634 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8573227d-416a-4231-84f3-9ff199575fbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:41.724272 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8573227d-416a-4231-84f3-9ff199575fbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:41.731791 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8573227d-416a-4231-84f3-9ff199575fbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:41.732218 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8573227d-416a-4231-84f3-9ff199575fbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:41.733001 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8573227d-416a-4231-84f3-9ff199575fbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:41.733439 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8573227d-416a-4231-84f3-9ff199575fbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:41.866695 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-8573227d-416a-4231-84f3-9ff199575fbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:41.875384 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8573227d-416a-4231-84f3-9ff199575fbb tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.156149 Nov 11 20:47:41.876056 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 627/1400] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:41 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:42.624283 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fa308f19-518d-462a-8b6a-44cbf6b8b9b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:42.624891 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-fa308f19-518d-462a-8b6a-44cbf6b8b9b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:42.630949 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fa308f19-518d-462a-8b6a-44cbf6b8b9b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:42.631398 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fa308f19-518d-462a-8b6a-44cbf6b8b9b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:42.632202 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fa308f19-518d-462a-8b6a-44cbf6b8b9b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:42.632664 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-fa308f19-518d-462a-8b6a-44cbf6b8b9b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:42.647245 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-fa308f19-518d-462a-8b6a-44cbf6b8b9b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] HTTP exception thrown: Instance 971ec047-d7f9-4d3c-92e7-c7c532ece303 could not be found. Nov 11 20:47:42.647827 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-fa308f19-518d-462a-8b6a-44cbf6b8b9b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Returning 404 to user: Instance 971ec047-d7f9-4d3c-92e7-c7c532ece303 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:47:42.648673 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-fa308f19-518d-462a-8b6a-44cbf6b8b9b2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "DELETE /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 404 len: 111 microversion: 2.1 time: 0.028780 Nov 11 20:47:42.649213 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 774/1401] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:47:42 2021] DELETE /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:47:42.657057 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-329520cf-d2d3-4f98-a3ff-c13f59694104 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:42.657654 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-329520cf-d2d3-4f98-a3ff-c13f59694104 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: 971ec047-d7f9-4d3c-92e7-c7c532ece303] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:42.663350 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-329520cf-d2d3-4f98-a3ff-c13f59694104 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:42.663796 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-329520cf-d2d3-4f98-a3ff-c13f59694104 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:42.664592 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-329520cf-d2d3-4f98-a3ff-c13f59694104 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:42.665019 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-329520cf-d2d3-4f98-a3ff-c13f59694104 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:42.679102 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-329520cf-d2d3-4f98-a3ff-c13f59694104 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] HTTP exception thrown: Instance 971ec047-d7f9-4d3c-92e7-c7c532ece303 could not be found. Nov 11 20:47:42.679680 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-329520cf-d2d3-4f98-a3ff-c13f59694104 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Returning 404 to user: Instance 971ec047-d7f9-4d3c-92e7-c7c532ece303 could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:47:42.680520 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-329520cf-d2d3-4f98-a3ff-c13f59694104 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303" status: 404 len: 111 microversion: 2.1 time: 0.027093 Nov 11 20:47:42.681086 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 628/1402] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:42 2021] GET /compute/v2.1/servers/971ec047-d7f9-4d3c-92e7-c7c532ece303 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:47:42.892230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cfceba34-111c-4844-a77b-25075d90f033 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:42.892759 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cfceba34-111c-4844-a77b-25075d90f033 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:42.898829 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cfceba34-111c-4844-a77b-25075d90f033 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:42.899277 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cfceba34-111c-4844-a77b-25075d90f033 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:42.900101 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cfceba34-111c-4844-a77b-25075d90f033 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:42.900590 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cfceba34-111c-4844-a77b-25075d90f033 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:43.034889 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cfceba34-111c-4844-a77b-25075d90f033 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:43.044388 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cfceba34-111c-4844-a77b-25075d90f033 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.155827 Nov 11 20:47:43.044937 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 775/1403] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:42 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:47:43.806400 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-60b878dd-a7cf-44cb-a5cb-85ae9c37d0bb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:43.807004 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-60b878dd-a7cf-44cb-a5cb-85ae9c37d0bb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:43.813720 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-60b878dd-a7cf-44cb-a5cb-85ae9c37d0bb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:43.814163 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-60b878dd-a7cf-44cb-a5cb-85ae9c37d0bb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:43.814975 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-60b878dd-a7cf-44cb-a5cb-85ae9c37d0bb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:43.815407 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-60b878dd-a7cf-44cb-a5cb-85ae9c37d0bb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:43.829143 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-60b878dd-a7cf-44cb-a5cb-85ae9c37d0bb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] HTTP exception thrown: Instance d03811f1-6242-47b2-be06-1ed656918ccb could not be found. Nov 11 20:47:43.829755 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-60b878dd-a7cf-44cb-a5cb-85ae9c37d0bb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Returning 404 to user: Instance d03811f1-6242-47b2-be06-1ed656918ccb could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:47:43.830560 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-60b878dd-a7cf-44cb-a5cb-85ae9c37d0bb tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 404 len: 111 microversion: 2.1 time: 0.027835 Nov 11 20:47:43.831082 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 629/1404] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:47:43 2021] DELETE /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:47:43.839522 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f7429661-ce58-4784-ad0c-fe1fe3eb1dd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:43.840167 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-f7429661-ce58-4784-ad0c-fe1fe3eb1dd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] [instance: d03811f1-6242-47b2-be06-1ed656918ccb] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:43.846920 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f7429661-ce58-4784-ad0c-fe1fe3eb1dd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:43.847368 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f7429661-ce58-4784-ad0c-fe1fe3eb1dd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:43.848210 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f7429661-ce58-4784-ad0c-fe1fe3eb1dd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:43.848646 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-f7429661-ce58-4784-ad0c-fe1fe3eb1dd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:43.862562 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-f7429661-ce58-4784-ad0c-fe1fe3eb1dd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] HTTP exception thrown: Instance d03811f1-6242-47b2-be06-1ed656918ccb could not be found. Nov 11 20:47:43.863183 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-f7429661-ce58-4784-ad0c-fe1fe3eb1dd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] Returning 404 to user: Instance d03811f1-6242-47b2-be06-1ed656918ccb could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:47:43.864022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-f7429661-ce58-4784-ad0c-fe1fe3eb1dd2 tempest-AttachVolumeTestJSON-390603001 tempest-AttachVolumeTestJSON-390603001-project] 10.222.0.61 "GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb" status: 404 len: 111 microversion: 2.1 time: 0.028874 Nov 11 20:47:43.864559 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 776/1405] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:43 2021] GET /compute/v2.1/servers/d03811f1-6242-47b2-be06-1ed656918ccb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:47:44.061597 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fe4311f8-3c7a-4a7a-b88a-e99f0c83ebec tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:44.062465 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fe4311f8-3c7a-4a7a-b88a-e99f0c83ebec tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:44.068240 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fe4311f8-3c7a-4a7a-b88a-e99f0c83ebec tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:44.068690 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fe4311f8-3c7a-4a7a-b88a-e99f0c83ebec tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:44.069462 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fe4311f8-3c7a-4a7a-b88a-e99f0c83ebec tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:44.070059 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fe4311f8-3c7a-4a7a-b88a-e99f0c83ebec tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:44.555616 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-fe4311f8-3c7a-4a7a-b88a-e99f0c83ebec tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:44.564350 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fe4311f8-3c7a-4a7a-b88a-e99f0c83ebec tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.506980 Nov 11 20:47:44.564918 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 630/1406] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:44 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:45.582191 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-61d1c40f-4935-4938-bcda-c6152d3b6827 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:45.582814 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-61d1c40f-4935-4938-bcda-c6152d3b6827 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:45.589221 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61d1c40f-4935-4938-bcda-c6152d3b6827 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:45.589676 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61d1c40f-4935-4938-bcda-c6152d3b6827 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:45.590459 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61d1c40f-4935-4938-bcda-c6152d3b6827 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:45.590886 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61d1c40f-4935-4938-bcda-c6152d3b6827 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:45.767931 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-61d1c40f-4935-4938-bcda-c6152d3b6827 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:45.776313 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-61d1c40f-4935-4938-bcda-c6152d3b6827 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.197674 Nov 11 20:47:45.777242 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 777/1407] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:45 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:46.794835 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-6f6c3414-f995-4487-a4bf-ed789369445a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:46.795454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-6f6c3414-f995-4487-a4bf-ed789369445a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:46.802464 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f6c3414-f995-4487-a4bf-ed789369445a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:46.802916 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f6c3414-f995-4487-a4bf-ed789369445a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:46.803899 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f6c3414-f995-4487-a4bf-ed789369445a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:46.804365 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-6f6c3414-f995-4487-a4bf-ed789369445a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:46.957632 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-6f6c3414-f995-4487-a4bf-ed789369445a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:46.972475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-6f6c3414-f995-4487-a4bf-ed789369445a tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.181350 Nov 11 20:47:46.973672 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 631/1408] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:46 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:47.990250 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b4c93469-afe6-48c7-b732-9fa75a12962f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:47.991481 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b4c93469-afe6-48c7-b732-9fa75a12962f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:47.998971 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b4c93469-afe6-48c7-b732-9fa75a12962f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:47.999421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b4c93469-afe6-48c7-b732-9fa75a12962f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:48.000239 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b4c93469-afe6-48c7-b732-9fa75a12962f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:48.000857 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b4c93469-afe6-48c7-b732-9fa75a12962f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:48.144468 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b4c93469-afe6-48c7-b732-9fa75a12962f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:48.152501 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b4c93469-afe6-48c7-b732-9fa75a12962f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.165828 Nov 11 20:47:48.153299 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 778/1409] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:47 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:48.576310 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-5b1cfe51-7abd-4520-80b1-e652fcc3fadf tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Action: 'create', calling method: .version_select at 0x7ff3f2a4f310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-235442996"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:48.862883 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-5b1cfe51-7abd-4520-80b1-e652fcc3fadf tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.397016 Nov 11 20:47:48.863502 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 632/1410] 10.222.0.61 () {60 vars in 1154 bytes} [Thu Nov 11 20:47:48 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 398 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 11 20:47:48.874810 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bbf56c61-722c-4735-8e87-80c8be9d0f6f tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3ee4969d0>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:48.922037 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bbf56c61-722c-4735-8e87-80c8be9d0f6f tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2" status: 200 len: 344 microversion: 2.1 time: 0.050764 Nov 11 20:47:48.922908 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 779/1411] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:47:48 2021] GET /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:49.170661 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-04c25ccd-0e25-4055-8562-57bf3ff7f414 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:49.171337 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-04c25ccd-0e25-4055-8562-57bf3ff7f414 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:49.178269 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-04c25ccd-0e25-4055-8562-57bf3ff7f414 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:49.178714 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-04c25ccd-0e25-4055-8562-57bf3ff7f414 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:49.179490 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-04c25ccd-0e25-4055-8562-57bf3ff7f414 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:49.179924 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-04c25ccd-0e25-4055-8562-57bf3ff7f414 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:49.311595 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-04c25ccd-0e25-4055-8562-57bf3ff7f414 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:49.318934 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-04c25ccd-0e25-4055-8562-57bf3ff7f414 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.152606 Nov 11 20:47:49.319498 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 633/1412] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:49 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:49.935408 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cbc7db4c-25a6-44eb-88b9-d28e7133e1ae tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3ee650160>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:49.980555 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cbc7db4c-25a6-44eb-88b9-d28e7133e1ae tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2" status: 200 len: 345 microversion: 2.1 time: 0.049745 Nov 11 20:47:49.981121 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 780/1413] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:47:49 2021] GET /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:49.991583 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-911606ca-584d-43db-b2df-703302518936 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Action: 'create', calling method: .version_select at 0x7ff3f29ffdc0>, body: {"snapshot": {"volume_id": "c4d745ba-d2c7-45ac-befd-d90e4d1920b2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-840949241"}} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:50.139304 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-911606ca-584d-43db-b2df-703302518936 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.151153 Nov 11 20:47:50.139863 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 634/1414] 10.222.0.61 () {60 vars in 1161 bytes} [Thu Nov 11 20:47:49 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:50.150024 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-37aa147b-28b4-4d2f-82f5-83a9b50d10e6 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3edae5af0>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:50.181832 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-37aa147b-28b4-4d2f-82f5-83a9b50d10e6 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20" status: 200 len: 286 microversion: 2.1 time: 0.036000 Nov 11 20:47:50.182418 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 781/1415] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Nov 11 20:47:50 2021] GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:50.193025 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-57577d2c-a431-4d89-b5fd-4967a22da691 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3eda2a430>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:50.223583 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-57577d2c-a431-4d89-b5fd-4967a22da691 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034570 Nov 11 20:47:50.224192 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 635/1416] 10.222.0.61 () {58 vars in 1139 bytes} [Thu Nov 11 20:47:50 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:50.234679 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-86735a00-24f0-4909-8639-d6f53483f291 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3edae5280>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:50.263305 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-86735a00-24f0-4909-8639-d6f53483f291 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20" status: 200 len: 286 microversion: 2.1 time: 0.032189 Nov 11 20:47:50.264067 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 782/1417] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Nov 11 20:47:50 2021] GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:50.335520 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d3f15869-f49f-48ae-9cbc-f076009b615d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:50.336169 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d3f15869-f49f-48ae-9cbc-f076009b615d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:50.342349 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d3f15869-f49f-48ae-9cbc-f076009b615d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:50.342788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d3f15869-f49f-48ae-9cbc-f076009b615d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:50.343556 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d3f15869-f49f-48ae-9cbc-f076009b615d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:50.343990 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d3f15869-f49f-48ae-9cbc-f076009b615d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:50.478313 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d3f15869-f49f-48ae-9cbc-f076009b615d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:50.486219 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d3f15869-f49f-48ae-9cbc-f076009b615d tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.154361 Nov 11 20:47:50.486782 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 636/1418] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:50 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:51.275214 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c3e469cf-06cd-4171-b343-6cf1b587d914 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3ee5d2550>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:51.303870 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c3e469cf-06cd-4171-b343-6cf1b587d914 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20" status: 200 len: 286 microversion: 2.1 time: 0.032817 Nov 11 20:47:51.304459 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 783/1419] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Nov 11 20:47:51 2021] GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:51.502817 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3f8a383b-dcd7-4356-afa3-3fbe634a5a74 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:51.503418 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3f8a383b-dcd7-4356-afa3-3fbe634a5a74 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:51.509635 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3f8a383b-dcd7-4356-afa3-3fbe634a5a74 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:51.510215 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3f8a383b-dcd7-4356-afa3-3fbe634a5a74 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:51.511493 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3f8a383b-dcd7-4356-afa3-3fbe634a5a74 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:51.511923 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3f8a383b-dcd7-4356-afa3-3fbe634a5a74 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:51.642228 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3f8a383b-dcd7-4356-afa3-3fbe634a5a74 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:51.649533 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3f8a383b-dcd7-4356-afa3-3fbe634a5a74 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.150394 Nov 11 20:47:51.650122 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 637/1420] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:51 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:52.315744 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c8fa3833-a394-46f7-bc7f-068635f7915e tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3ee4299d0>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:52.344534 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c8fa3833-a394-46f7-bc7f-068635f7915e tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20" status: 200 len: 286 microversion: 2.1 time: 0.032760 Nov 11 20:47:52.345343 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 784/1421] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Nov 11 20:47:52 2021] GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:52.666473 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4e5cffba-7dcd-4c3a-be0b-7c1d2507f167 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:52.667225 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-4e5cffba-7dcd-4c3a-be0b-7c1d2507f167 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:52.673883 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4e5cffba-7dcd-4c3a-be0b-7c1d2507f167 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:52.674329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4e5cffba-7dcd-4c3a-be0b-7c1d2507f167 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:52.675138 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4e5cffba-7dcd-4c3a-be0b-7c1d2507f167 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:52.675575 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-4e5cffba-7dcd-4c3a-be0b-7c1d2507f167 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:52.807395 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-4e5cffba-7dcd-4c3a-be0b-7c1d2507f167 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:52.814755 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4e5cffba-7dcd-4c3a-be0b-7c1d2507f167 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.152071 Nov 11 20:47:52.815329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 638/1422] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:52 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:53.357032 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6dc4ed7e-872a-4cc9-b698-d2ed7b3046d3 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3ee4969d0>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:53.386678 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6dc4ed7e-872a-4cc9-b698-d2ed7b3046d3 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20" status: 200 len: 287 microversion: 2.1 time: 0.034378 Nov 11 20:47:53.387524 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 785/1423] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Nov 11 20:47:53 2021] GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:53.397509 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-af11e5fb-8c1f-41d1-8678-9b940210708b tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3eda70ee0>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:53.452522 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-af11e5fb-8c1f-41d1-8678-9b940210708b tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20" status: 202 len: 0 microversion: 2.1 time: 0.058476 Nov 11 20:47:53.453096 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 639/1424] 10.222.0.61 () {58 vars in 1253 bytes} [Thu Nov 11 20:47:53 2021] DELETE /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:47:53.460938 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-54ef4bee-0092-411e-bb45-193bdd330d0a tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3ee613940>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:53.489470 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-54ef4bee-0092-411e-bb45-193bdd330d0a tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20" status: 200 len: 286 microversion: 2.1 time: 0.032068 Nov 11 20:47:53.490109 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 786/1425] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Nov 11 20:47:53 2021] GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:53.832499 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1ad79793-9afb-4b56-81f4-372d30a00c65 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:53.833110 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1ad79793-9afb-4b56-81f4-372d30a00c65 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:53.839310 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1ad79793-9afb-4b56-81f4-372d30a00c65 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:53.839757 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1ad79793-9afb-4b56-81f4-372d30a00c65 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:53.840583 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1ad79793-9afb-4b56-81f4-372d30a00c65 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:53.841012 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1ad79793-9afb-4b56-81f4-372d30a00c65 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:53.974139 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-1ad79793-9afb-4b56-81f4-372d30a00c65 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:53.981948 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1ad79793-9afb-4b56-81f4-372d30a00c65 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.153540 Nov 11 20:47:53.982696 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 640/1426] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:53 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:54.501644 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d03d8db9-b69e-4f7a-bbe2-a13fb9109649 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3edbfeb80>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:54.528134 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-d03d8db9-b69e-4f7a-bbe2-a13fb9109649 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] HTTP exception thrown: Snapshot a662c819-a1f3-4f75-b814-3b9f93adbb20 could not be found. Nov 11 20:47:54.528734 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d03d8db9-b69e-4f7a-bbe2-a13fb9109649 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Returning 404 to user: Snapshot a662c819-a1f3-4f75-b814-3b9f93adbb20 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:47:54.529616 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d03d8db9-b69e-4f7a-bbe2-a13fb9109649 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20" status: 404 len: 111 microversion: 2.1 time: 0.032090 Nov 11 20:47:54.530162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 787/1427] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Nov 11 20:47:54 2021] GET /compute/v2.1/os-snapshots/a662c819-a1f3-4f75-b814-3b9f93adbb20 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:47:54.538189 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-87affc35-86c3-4dd0-a6c8-9d5e7e0c3b78 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3eda70c10>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:54.596668 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-87affc35-86c3-4dd0-a6c8-9d5e7e0c3b78 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2" status: 202 len: 0 microversion: 2.1 time: 0.062028 Nov 11 20:47:54.597249 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 641/1428] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Nov 11 20:47:54 2021] DELETE /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:47:54.606515 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-73265f90-18c5-48b3-a452-e870bc721ad7 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3edae5790>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:54.653369 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-73265f90-18c5-48b3-a452-e870bc721ad7 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2" status: 200 len: 344 microversion: 2.1 time: 0.051302 Nov 11 20:47:54.654048 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 788/1429] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:47:54 2021] GET /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:54.999879 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-9f4ccb79-82af-429e-b6e3-43dd410e4d09 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:55.000914 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-9f4ccb79-82af-429e-b6e3-43dd410e4d09 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:55.006865 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9f4ccb79-82af-429e-b6e3-43dd410e4d09 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:55.007304 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9f4ccb79-82af-429e-b6e3-43dd410e4d09 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:55.008094 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9f4ccb79-82af-429e-b6e3-43dd410e4d09 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:55.008520 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-9f4ccb79-82af-429e-b6e3-43dd410e4d09 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:55.142214 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-9f4ccb79-82af-429e-b6e3-43dd410e4d09 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:55.149458 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-9f4ccb79-82af-429e-b6e3-43dd410e4d09 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.154710 Nov 11 20:47:55.150016 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 642/1430] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:54 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:55.666298 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cd9d782d-5ba5-49f4-b246-b3e1c5aa0dea tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3ee496160>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:55.693406 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-cd9d782d-5ba5-49f4-b246-b3e1c5aa0dea tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] HTTP exception thrown: Volume c4d745ba-d2c7-45ac-befd-d90e4d1920b2 could not be found. Nov 11 20:47:55.694001 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cd9d782d-5ba5-49f4-b246-b3e1c5aa0dea tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Returning 404 to user: Volume c4d745ba-d2c7-45ac-befd-d90e4d1920b2 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:47:55.694872 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cd9d782d-5ba5-49f4-b246-b3e1c5aa0dea tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2" status: 404 len: 109 microversion: 2.1 time: 0.032702 Nov 11 20:47:55.695483 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 789/1431] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:47:55 2021] GET /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:47:55.705418 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-06e5a0cf-4fdf-4459-912b-51c84a1174a6 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3eda70b80>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:55.732609 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-06e5a0cf-4fdf-4459-912b-51c84a1174a6 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] HTTP exception thrown: Volume c4d745ba-d2c7-45ac-befd-d90e4d1920b2 could not be found. Nov 11 20:47:55.733225 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-06e5a0cf-4fdf-4459-912b-51c84a1174a6 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Returning 404 to user: Volume c4d745ba-d2c7-45ac-befd-d90e4d1920b2 could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:47:55.734072 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-06e5a0cf-4fdf-4459-912b-51c84a1174a6 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2" status: 404 len: 109 microversion: 2.1 time: 0.032513 Nov 11 20:47:55.734655 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 643/1432] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Nov 11 20:47:55 2021] DELETE /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:47:55.742958 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3ea05e6b-91b9-40b1-ac09-b648831ec083 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Calling method '.version_select at 0x7ff3ed985700>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:55.769409 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-3ea05e6b-91b9-40b1-ac09-b648831ec083 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] HTTP exception thrown: Volume c4d745ba-d2c7-45ac-befd-d90e4d1920b2 could not be found. Nov 11 20:47:55.770008 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-3ea05e6b-91b9-40b1-ac09-b648831ec083 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] Returning 404 to user: Volume c4d745ba-d2c7-45ac-befd-d90e4d1920b2 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:47:55.771052 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-3ea05e6b-91b9-40b1-ac09-b648831ec083 tempest-VolumesSnapshotsTestJSON-33388480 tempest-VolumesSnapshotsTestJSON-33388480-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2" status: 404 len: 109 microversion: 2.1 time: 0.031686 Nov 11 20:47:55.771579 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 790/1433] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:47:55 2021] GET /compute/v2.1/os-volumes/c4d745ba-d2c7-45ac-befd-d90e4d1920b2 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:47:56.167840 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d0d68c5e-7e45-4f43-bdaa-edc7dae15a24 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:56.168506 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d0d68c5e-7e45-4f43-bdaa-edc7dae15a24 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:56.175851 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d0d68c5e-7e45-4f43-bdaa-edc7dae15a24 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:56.176371 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d0d68c5e-7e45-4f43-bdaa-edc7dae15a24 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:56.177173 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d0d68c5e-7e45-4f43-bdaa-edc7dae15a24 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:56.177615 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-d0d68c5e-7e45-4f43-bdaa-edc7dae15a24 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:56.316866 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d0d68c5e-7e45-4f43-bdaa-edc7dae15a24 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:56.325131 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d0d68c5e-7e45-4f43-bdaa-edc7dae15a24 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.161830 Nov 11 20:47:56.325702 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 644/1434] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:56 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:57.039043 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8d6f6be8-c94c-4024-9316-34500db3a33c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:57.040032 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8d6f6be8-c94c-4024-9316-34500db3a33c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:57.046195 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8d6f6be8-c94c-4024-9316-34500db3a33c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:57.046641 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8d6f6be8-c94c-4024-9316-34500db3a33c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:57.047419 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8d6f6be8-c94c-4024-9316-34500db3a33c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:57.047855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8d6f6be8-c94c-4024-9316-34500db3a33c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:57.076607 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8d6f6be8-c94c-4024-9316-34500db3a33c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041308 Nov 11 20:47:57.077174 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 645/1435] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Nov 11 20:47:57 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:47:57.131679 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ef16d499-215c-4589-b8e2-396e7ea1b140 tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] Action: 'create', calling method: .version_select at 0x7ff3ee613280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-575376288", "metadata": {"Type": "work"}}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:47:57.133384 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-dbec0cec-8897-4d58-aad2-5871719ac980 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:57.133883 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-dbec0cec-8897-4d58-aad2-5871719ac980 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:57.140406 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dbec0cec-8897-4d58-aad2-5871719ac980 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:57.140863 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dbec0cec-8897-4d58-aad2-5871719ac980 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:57.141655 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dbec0cec-8897-4d58-aad2-5871719ac980 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:57.142095 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dbec0cec-8897-4d58-aad2-5871719ac980 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:57.166804 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-dbec0cec-8897-4d58-aad2-5871719ac980 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Going to try to terminate instance {{(pid=122527) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:47:57.252483 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-dbec0cec-8897-4d58-aad2-5871719ac980 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "DELETE /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 204 len: 0 microversion: 2.20 time: 0.121774 Nov 11 20:47:57.253199 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 646/1436] 10.222.0.61 () {60 vars in 1279 bytes} [Thu Nov 11 20:47:57 2021] DELETE /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 11 20:47:57.261656 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-a1e041b3-c07f-42a8-9706-5f9d7181bbd2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:57.262361 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-a1e041b3-c07f-42a8-9706-5f9d7181bbd2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:57.268938 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1e041b3-c07f-42a8-9706-5f9d7181bbd2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:57.269609 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1e041b3-c07f-42a8-9706-5f9d7181bbd2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:57.270581 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1e041b3-c07f-42a8-9706-5f9d7181bbd2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:57.271020 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-a1e041b3-c07f-42a8-9706-5f9d7181bbd2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:57.445753 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ef16d499-215c-4589-b8e2-396e7ea1b140 tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.428726 Nov 11 20:47:57.446544 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 791/1437] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Nov 11 20:47:57 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 430 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 11 20:47:57.452148 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0ca57e28-d5fe-400e-a692-5687f2956abf tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:57.453348 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0ca57e28-d5fe-400e-a692-5687f2956abf tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:57.460361 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ca57e28-d5fe-400e-a692-5687f2956abf tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:57.460361 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ca57e28-d5fe-400e-a692-5687f2956abf tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:57.461015 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ca57e28-d5fe-400e-a692-5687f2956abf tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:57.461607 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0ca57e28-d5fe-400e-a692-5687f2956abf tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:57.559791 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a1e041b3-c07f-42a8-9706-5f9d7181bbd2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:57.568970 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a1e041b3-c07f-42a8-9706-5f9d7181bbd2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:57.570503 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-a1e041b3-c07f-42a8-9706-5f9d7181bbd2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:57.571709 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-a1e041b3-c07f-42a8-9706-5f9d7181bbd2 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.314114 Nov 11 20:47:57.572326 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 647/1438] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:47:57 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 11 20:47:57.585008 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1399e208-a2d1-41bc-bc07-2ec959f7ba75 tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] Calling method '.version_select at 0x7ff3f2a4fa60>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:57.632718 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1399e208-a2d1-41bc-bc07-2ec959f7ba75 tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b033d5fe-5f4f-42f2-a09f-2e3121d3565a" status: 200 len: 352 microversion: 2.1 time: 0.051561 Nov 11 20:47:57.633731 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 648/1439] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:47:57 2021] GET /compute/v2.1/os-volumes/b033d5fe-5f4f-42f2-a09f-2e3121d3565a => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:57.669496 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-0ca57e28-d5fe-400e-a692-5687f2956abf tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:57.676825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0ca57e28-d5fe-400e-a692-5687f2956abf tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.228892 Nov 11 20:47:57.677397 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 792/1440] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:57 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:58.591272 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c318265b-9fb0-488b-a12f-7c37a175fd0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:58.591855 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-c318265b-9fb0-488b-a12f-7c37a175fd0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:58.598091 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c318265b-9fb0-488b-a12f-7c37a175fd0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:58.598536 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c318265b-9fb0-488b-a12f-7c37a175fd0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:58.599300 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c318265b-9fb0-488b-a12f-7c37a175fd0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:58.599727 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-c318265b-9fb0-488b-a12f-7c37a175fd0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:58.645520 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4405846e-5c64-4bd6-a021-a83d0347a028 tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] Calling method '.version_select at 0x7ff3f2a311f0>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:58.692847 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4405846e-5c64-4bd6-a021-a83d0347a028 tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b033d5fe-5f4f-42f2-a09f-2e3121d3565a" status: 200 len: 353 microversion: 2.1 time: 0.050966 Nov 11 20:47:58.693424 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 793/1441] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:47:58 2021] GET /compute/v2.1/os-volumes/b033d5fe-5f4f-42f2-a09f-2e3121d3565a => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:47:58.697731 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a9f54ebe-5ad6-4924-b73d-7735b7894d37 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:58.698368 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a9f54ebe-5ad6-4924-b73d-7735b7894d37 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:58.704580 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9f54ebe-5ad6-4924-b73d-7735b7894d37 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:58.705035 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9f54ebe-5ad6-4924-b73d-7735b7894d37 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:58.705831 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9f54ebe-5ad6-4924-b73d-7735b7894d37 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:58.706265 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9f54ebe-5ad6-4924-b73d-7735b7894d37 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:58.742028 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c318265b-9fb0-488b-a12f-7c37a175fd0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:58.752833 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c318265b-9fb0-488b-a12f-7c37a175fd0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:58.754313 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-c318265b-9fb0-488b-a12f-7c37a175fd0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:58.755468 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c318265b-9fb0-488b-a12f-7c37a175fd0b tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.168584 Nov 11 20:47:58.756276 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 649/1442] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:47:58 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:47:58.760351 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-c9429d5c-702f-43bf-a01b-0cf2a7d94bb4 tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] Calling method '.version_select at 0x7ff3eda2a430>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:58.807197 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-c9429d5c-702f-43bf-a01b-0cf2a7d94bb4 tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b033d5fe-5f4f-42f2-a09f-2e3121d3565a" status: 200 len: 353 microversion: 2.1 time: 0.050031 Nov 11 20:47:58.807783 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 650/1443] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:47:58 2021] GET /compute/v2.1/os-volumes/b033d5fe-5f4f-42f2-a09f-2e3121d3565a => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:47:58.824833 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8947d781-e907-492a-bab2-b3d6a3fe4d99 tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] Calling method '.version_select at 0x7ff3eda2aee0>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:58.859149 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-a9f54ebe-5ad6-4924-b73d-7735b7894d37 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:47:58.866930 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a9f54ebe-5ad6-4924-b73d-7735b7894d37 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.172565 Nov 11 20:47:58.867703 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 794/1444] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:58 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:47:58.888184 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8947d781-e907-492a-bab2-b3d6a3fe4d99 tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/b033d5fe-5f4f-42f2-a09f-2e3121d3565a" status: 202 len: 0 microversion: 2.1 time: 0.067104 Nov 11 20:47:58.888820 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 651/1445] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Nov 11 20:47:58 2021] DELETE /compute/v2.1/os-volumes/b033d5fe-5f4f-42f2-a09f-2e3121d3565a => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 11 20:47:58.896747 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-6d525f41-fbf7-4b66-ad45-aa66a6198c69 tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] Calling method '.version_select at 0x7ff3f2a31820>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:58.944296 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-6d525f41-fbf7-4b66-ad45-aa66a6198c69 tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b033d5fe-5f4f-42f2-a09f-2e3121d3565a" status: 200 len: 352 microversion: 2.1 time: 0.051207 Nov 11 20:47:58.944861 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 795/1446] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:47:58 2021] GET /compute/v2.1/os-volumes/b033d5fe-5f4f-42f2-a09f-2e3121d3565a => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:47:59.775119 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-090b72ab-17d8-43cb-9593-98a35dd5672d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:59.776221 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-090b72ab-17d8-43cb-9593-98a35dd5672d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:59.782730 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-090b72ab-17d8-43cb-9593-98a35dd5672d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:59.783178 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-090b72ab-17d8-43cb-9593-98a35dd5672d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:59.784164 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-090b72ab-17d8-43cb-9593-98a35dd5672d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:59.784412 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-090b72ab-17d8-43cb-9593-98a35dd5672d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:59.885485 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-c144fb42-5705-492c-b012-79167f064bdd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:47:59.886093 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-c144fb42-5705-492c-b012-79167f064bdd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:47:59.893199 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c144fb42-5705-492c-b012-79167f064bdd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:59.893643 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c144fb42-5705-492c-b012-79167f064bdd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:47:59.894429 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c144fb42-5705-492c-b012-79167f064bdd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:47:59.895306 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-c144fb42-5705-492c-b012-79167f064bdd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:00.031111 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-090b72ab-17d8-43cb-9593-98a35dd5672d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:00.039089 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-090b72ab-17d8-43cb-9593-98a35dd5672d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:00.041414 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-090b72ab-17d8-43cb-9593-98a35dd5672d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:00.041820 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-090b72ab-17d8-43cb-9593-98a35dd5672d tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1722 microversion: 2.20 time: 0.270885 Nov 11 20:48:00.046479 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 652/1447] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:47:59 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:48:00.046875 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4eccecb8-b236-470f-a2fd-2e9bb348346a tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] Calling method '.version_select at 0x7ff3eda47670>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:00.073389 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-4eccecb8-b236-470f-a2fd-2e9bb348346a tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] HTTP exception thrown: Volume b033d5fe-5f4f-42f2-a09f-2e3121d3565a could not be found. Nov 11 20:48:00.073996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-4eccecb8-b236-470f-a2fd-2e9bb348346a tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] Returning 404 to user: Volume b033d5fe-5f4f-42f2-a09f-2e3121d3565a could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:48:00.074897 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-4eccecb8-b236-470f-a2fd-2e9bb348346a tempest-VolumesGetTestJSON-2060633706 tempest-VolumesGetTestJSON-2060633706-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b033d5fe-5f4f-42f2-a09f-2e3121d3565a" status: 404 len: 109 microversion: 2.1 time: 0.031598 Nov 11 20:48:00.076923 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 653/1448] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Nov 11 20:48:00 2021] GET /compute/v2.1/os-volumes/b033d5fe-5f4f-42f2-a09f-2e3121d3565a => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:48:00.169881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-c144fb42-5705-492c-b012-79167f064bdd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:00.177547 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-c144fb42-5705-492c-b012-79167f064bdd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.296601 Nov 11 20:48:00.178137 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 796/1449] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:47:59 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:48:00.429473 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-a23caf17-e779-45f9-960f-a55ab7ea88e7 req-fd3e5312-d6be-40fd-bf16-757779512ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e", "name": "network-vif-deleted", "tag": "962e998a-c58f-4876-b93f-8de3af37c538"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:48:00.431329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:48:00.431329 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:48:00.444588 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-a23caf17-e779-45f9-960f-a55ab7ea88e7 req-fd3e5312-d6be-40fd-bf16-757779512ab5 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:00.445284 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-a23caf17-e779-45f9-960f-a55ab7ea88e7 req-fd3e5312-d6be-40fd-bf16-757779512ab5 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:00.462717 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-a23caf17-e779-45f9-960f-a55ab7ea88e7 req-fd3e5312-d6be-40fd-bf16-757779512ab5 service nova] Creating event network-vif-deleted:962e998a-c58f-4876-b93f-8de3af37c538 for instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e on hv-cinder-81764 Nov 11 20:48:00.474659 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-a23caf17-e779-45f9-960f-a55ab7ea88e7 req-fd3e5312-d6be-40fd-bf16-757779512ab5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049186 Nov 11 20:48:00.475260 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 654/1450] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:48:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:48:01.061320 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:01.061935 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:01.068308 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:01.068776 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:01.069549 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:01.069985 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:01.103165 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:01.103823 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:01.104843 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lazy-loading 'fault' on Instance uuid 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:48:01.165258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:01.176620 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:01.179449 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3e90865af2147c995fb58e24129d032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d540a76ef9405bb94b7e433494fabd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:01.180878 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-05ae4ec3-0bb8-4cb5-9ad4-fb195e94fa96 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 200 len: 1371 microversion: 2.20 time: 0.124408 Nov 11 20:48:01.181863 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 797/1451] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:48:01 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 1371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 11 20:48:01.198736 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-dc38dd19-1674-4da4-ab1d-0a5eccf75303 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:01.200128 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-dc38dd19-1674-4da4-ab1d-0a5eccf75303 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:01.207752 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dc38dd19-1674-4da4-ab1d-0a5eccf75303 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:01.208439 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dc38dd19-1674-4da4-ab1d-0a5eccf75303 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:01.209415 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dc38dd19-1674-4da4-ab1d-0a5eccf75303 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:01.210016 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dc38dd19-1674-4da4-ab1d-0a5eccf75303 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:01.384736 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-dc38dd19-1674-4da4-ab1d-0a5eccf75303 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:01.393590 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-dc38dd19-1674-4da4-ab1d-0a5eccf75303 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1511 microversion: 2.1 time: 0.199965 Nov 11 20:48:01.394244 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 655/1452] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:01 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:01.409836 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4d10b1d9-8159-4e15-a599-f2e1928a039c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:48:01.410403 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4d10b1d9-8159-4e15-a599-f2e1928a039c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:01.416638 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4d10b1d9-8159-4e15-a599-f2e1928a039c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:01.417098 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4d10b1d9-8159-4e15-a599-f2e1928a039c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:01.418111 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4d10b1d9-8159-4e15-a599-f2e1928a039c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:01.418560 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4d10b1d9-8159-4e15-a599-f2e1928a039c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:01.509444 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4d10b1d9-8159-4e15-a599-f2e1928a039c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "POST /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627/action" status: 202 len: 0 microversion: 2.1 time: 0.103243 Nov 11 20:48:01.510292 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 798/1453] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Nov 11 20:48:01 2021] POST /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:48:01.523046 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-ae1d0039-e24e-4390-b525-9a03b445f63c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:01.523734 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-ae1d0039-e24e-4390-b525-9a03b445f63c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:01.535777 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ae1d0039-e24e-4390-b525-9a03b445f63c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:01.536839 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ae1d0039-e24e-4390-b525-9a03b445f63c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:01.537912 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ae1d0039-e24e-4390-b525-9a03b445f63c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:01.539248 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-ae1d0039-e24e-4390-b525-9a03b445f63c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:01.710475 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-ae1d0039-e24e-4390-b525-9a03b445f63c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:01.718592 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-ae1d0039-e24e-4390-b525-9a03b445f63c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1519 microversion: 2.1 time: 0.201225 Nov 11 20:48:01.719178 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 656/1454] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:01 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:02.204970 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0fc2bb9a-16e3-425e-b8da-cb1919ef7bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:02.205562 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0fc2bb9a-16e3-425e-b8da-cb1919ef7bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:02.211325 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0fc2bb9a-16e3-425e-b8da-cb1919ef7bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:02.212006 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0fc2bb9a-16e3-425e-b8da-cb1919ef7bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:02.212819 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0fc2bb9a-16e3-425e-b8da-cb1919ef7bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:02.213260 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0fc2bb9a-16e3-425e-b8da-cb1919ef7bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:02.227336 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-0fc2bb9a-16e3-425e-b8da-cb1919ef7bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] HTTP exception thrown: Instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e could not be found. Nov 11 20:48:02.228174 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0fc2bb9a-16e3-425e-b8da-cb1919ef7bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Returning 404 to user: Instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:48:02.229171 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0fc2bb9a-16e3-425e-b8da-cb1919ef7bf9 tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 404 len: 111 microversion: 2.20 time: 0.029178 Nov 11 20:48:02.230011 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 799/1455] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Nov 11 20:48:02 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 11 20:48:02.238511 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-10f2efda-1982-475f-b83d-739f84a52d4c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '.version_select at 0x7ff3f29fdf70>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:02.258847 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-10f2efda-1982-475f-b83d-739f84a52d4c tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-900921978" status: 204 len: 0 microversion: 2.20 time: 0.023958 Nov 11 20:48:02.259488 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 657/1456] 10.222.0.61 () {60 vars in 1258 bytes} [Thu Nov 11 20:48:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-900921978 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 11 20:48:02.737016 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cf6d16ce-23b0-4fa8-a910-23baf82617a1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:02.737993 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cf6d16ce-23b0-4fa8-a910-23baf82617a1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:02.745295 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cf6d16ce-23b0-4fa8-a910-23baf82617a1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:02.745945 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cf6d16ce-23b0-4fa8-a910-23baf82617a1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:02.747469 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cf6d16ce-23b0-4fa8-a910-23baf82617a1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:02.748184 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cf6d16ce-23b0-4fa8-a910-23baf82617a1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:02.986885 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-cf6d16ce-23b0-4fa8-a910-23baf82617a1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:02.994467 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cf6d16ce-23b0-4fa8-a910-23baf82617a1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1521 microversion: 2.1 time: 0.261172 Nov 11 20:48:02.995108 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 800/1457] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:02 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:03.269405 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-a099053d-5dfb-4177-8c45-3f85b7f95aac req-8b5920fa-18a4-47ba-b121-9a53ca8ee870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a4baaf-615d-4da4-b61e-5a9199179627", "name": "network-vif-unplugged", "status": "completed", "tag": "40bfc231-ecda-4dd7-a914-d4fd0a2d487b"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:48:03.271228 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:48:03.271228 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:48:03.280293 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-a099053d-5dfb-4177-8c45-3f85b7f95aac req-8b5920fa-18a4-47ba-b121-9a53ca8ee870 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:03.280933 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-a099053d-5dfb-4177-8c45-3f85b7f95aac req-8b5920fa-18a4-47ba-b121-9a53ca8ee870 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:03.291794 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-a099053d-5dfb-4177-8c45-3f85b7f95aac req-8b5920fa-18a4-47ba-b121-9a53ca8ee870 service nova] Creating event network-vif-unplugged:40bfc231-ecda-4dd7-a914-d4fd0a2d487b for instance c9a4baaf-615d-4da4-b61e-5a9199179627 on hv-cinder-81764 Nov 11 20:48:03.298145 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-a099053d-5dfb-4177-8c45-3f85b7f95aac req-8b5920fa-18a4-47ba-b121-9a53ca8ee870 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032810 Nov 11 20:48:03.298738 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 658/1458] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:48:03 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:48:04.013545 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9afeefeb-ea3b-4670-a3ee-152e0e54a79f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:04.014253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9afeefeb-ea3b-4670-a3ee-152e0e54a79f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:04.021087 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9afeefeb-ea3b-4670-a3ee-152e0e54a79f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:04.021541 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9afeefeb-ea3b-4670-a3ee-152e0e54a79f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:04.022346 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9afeefeb-ea3b-4670-a3ee-152e0e54a79f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:04.022772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9afeefeb-ea3b-4670-a3ee-152e0e54a79f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:04.166288 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9afeefeb-ea3b-4670-a3ee-152e0e54a79f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:04.174876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9afeefeb-ea3b-4670-a3ee-152e0e54a79f tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1577 microversion: 2.1 time: 0.165404 Nov 11 20:48:04.175721 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 801/1459] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:04 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:04.239718 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-34223f7b-dea2-48f4-a583-e62952b5021f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:04.240432 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-34223f7b-dea2-48f4-a583-e62952b5021f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:04.246539 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-34223f7b-dea2-48f4-a583-e62952b5021f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:04.247206 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-34223f7b-dea2-48f4-a583-e62952b5021f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:04.247920 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-34223f7b-dea2-48f4-a583-e62952b5021f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:04.248372 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-34223f7b-dea2-48f4-a583-e62952b5021f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:04.261088 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-34223f7b-dea2-48f4-a583-e62952b5021f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] HTTP exception thrown: Instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e could not be found. Nov 11 20:48:04.261658 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-34223f7b-dea2-48f4-a583-e62952b5021f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Returning 404 to user: Instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:48:04.262458 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-34223f7b-dea2-48f4-a583-e62952b5021f tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "DELETE /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 404 len: 111 microversion: 2.1 time: 0.026825 Nov 11 20:48:04.263012 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 659/1460] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:48:04 2021] DELETE /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:48:04.270707 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a9d4f76d-4bfe-4801-a2ef-dd15ff290f9a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:04.271323 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a9d4f76d-4bfe-4801-a2ef-dd15ff290f9a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:04.277248 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9d4f76d-4bfe-4801-a2ef-dd15ff290f9a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:04.277716 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9d4f76d-4bfe-4801-a2ef-dd15ff290f9a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:04.279031 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9d4f76d-4bfe-4801-a2ef-dd15ff290f9a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:04.279484 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a9d4f76d-4bfe-4801-a2ef-dd15ff290f9a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:04.292516 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-a9d4f76d-4bfe-4801-a2ef-dd15ff290f9a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] HTTP exception thrown: Instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e could not be found. Nov 11 20:48:04.293101 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a9d4f76d-4bfe-4801-a2ef-dd15ff290f9a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Returning 404 to user: Instance 88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:48:04.294683 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a9d4f76d-4bfe-4801-a2ef-dd15ff290f9a tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e" status: 404 len: 111 microversion: 2.1 time: 0.026949 Nov 11 20:48:04.295182 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 802/1461] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:04 2021] GET /compute/v2.1/servers/88d40d3a-482a-4fa4-be6d-4c2dca6dfe7e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:48:05.193359 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-1e69469d-23bd-40e7-86a7-64c14618e9e5 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:05.193973 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-1e69469d-23bd-40e7-86a7-64c14618e9e5 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:05.200796 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1e69469d-23bd-40e7-86a7-64c14618e9e5 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:05.201540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1e69469d-23bd-40e7-86a7-64c14618e9e5 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:05.202328 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1e69469d-23bd-40e7-86a7-64c14618e9e5 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:05.202764 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-1e69469d-23bd-40e7-86a7-64c14618e9e5 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:05.344440 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-1e69469d-23bd-40e7-86a7-64c14618e9e5 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:05.351952 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-1e69469d-23bd-40e7-86a7-64c14618e9e5 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1577 microversion: 2.1 time: 0.162227 Nov 11 20:48:05.352540 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 660/1462] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:05 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:48:05.419392 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4243cbc5-9aef-49a7-a584-56ae8f653d7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:05.419883 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-4243cbc5-9aef-49a7-a584-56ae8f653d7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:05.426084 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4243cbc5-9aef-49a7-a584-56ae8f653d7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:05.426557 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4243cbc5-9aef-49a7-a584-56ae8f653d7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:05.427330 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4243cbc5-9aef-49a7-a584-56ae8f653d7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:05.427757 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-4243cbc5-9aef-49a7-a584-56ae8f653d7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:05.440681 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-4243cbc5-9aef-49a7-a584-56ae8f653d7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] HTTP exception thrown: Instance ce4a9f51-80d0-4901-beaf-9b03435f002c could not be found. Nov 11 20:48:05.441258 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-4243cbc5-9aef-49a7-a584-56ae8f653d7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Returning 404 to user: Instance ce4a9f51-80d0-4901-beaf-9b03435f002c could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:48:05.442063 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-4243cbc5-9aef-49a7-a584-56ae8f653d7e tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 404 len: 111 microversion: 2.1 time: 0.026569 Nov 11 20:48:05.442578 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 803/1463] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:48:05 2021] DELETE /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:48:05.451139 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e17b9160-3bb5-4529-8927-5c8fd9725dad tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:05.451931 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e17b9160-3bb5-4529-8927-5c8fd9725dad tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] [instance: ce4a9f51-80d0-4901-beaf-9b03435f002c] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:05.457728 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e17b9160-3bb5-4529-8927-5c8fd9725dad tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:05.458173 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e17b9160-3bb5-4529-8927-5c8fd9725dad tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:05.458943 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e17b9160-3bb5-4529-8927-5c8fd9725dad tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:05.459375 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e17b9160-3bb5-4529-8927-5c8fd9725dad tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:05.474521 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-e17b9160-3bb5-4529-8927-5c8fd9725dad tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] HTTP exception thrown: Instance ce4a9f51-80d0-4901-beaf-9b03435f002c could not be found. Nov 11 20:48:05.475105 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e17b9160-3bb5-4529-8927-5c8fd9725dad tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] Returning 404 to user: Instance ce4a9f51-80d0-4901-beaf-9b03435f002c could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:48:05.475917 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e17b9160-3bb5-4529-8927-5c8fd9725dad tempest-AttachVolumeShelveTestJSON-68904930 tempest-AttachVolumeShelveTestJSON-68904930-project] 10.222.0.61 "GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c" status: 404 len: 111 microversion: 2.1 time: 0.029294 Nov 11 20:48:05.476469 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 661/1464] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:05 2021] GET /compute/v2.1/servers/ce4a9f51-80d0-4901-beaf-9b03435f002c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:48:06.369507 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-970224ba-b6c2-4218-a3ce-a9e944084724 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:06.370066 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-970224ba-b6c2-4218-a3ce-a9e944084724 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:06.376217 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-970224ba-b6c2-4218-a3ce-a9e944084724 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:06.376668 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-970224ba-b6c2-4218-a3ce-a9e944084724 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:06.377452 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-970224ba-b6c2-4218-a3ce-a9e944084724 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:06.377888 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-970224ba-b6c2-4218-a3ce-a9e944084724 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:06.594822 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-970224ba-b6c2-4218-a3ce-a9e944084724 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:06.608202 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-970224ba-b6c2-4218-a3ce-a9e944084724 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1577 microversion: 2.1 time: 0.241919 Nov 11 20:48:06.608725 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 804/1465] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:06 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1577 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:07.626791 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-fc75beda-b562-40ce-a6a3-4e110a8599cd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:07.628352 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-fc75beda-b562-40ce-a6a3-4e110a8599cd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:07.636989 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fc75beda-b562-40ce-a6a3-4e110a8599cd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:07.637620 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fc75beda-b562-40ce-a6a3-4e110a8599cd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:07.639230 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fc75beda-b562-40ce-a6a3-4e110a8599cd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:07.639671 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-fc75beda-b562-40ce-a6a3-4e110a8599cd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:07.943930 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-fc75beda-b562-40ce-a6a3-4e110a8599cd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:07.952464 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-fc75beda-b562-40ce-a6a3-4e110a8599cd tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1577 microversion: 2.1 time: 0.331265 Nov 11 20:48:07.953343 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 662/1466] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:07 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1577 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:08.974463 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-b4c7089a-3cc2-4610-9356-387836f77291 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:08.975081 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-b4c7089a-3cc2-4610-9356-387836f77291 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:08.983210 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b4c7089a-3cc2-4610-9356-387836f77291 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:08.985831 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b4c7089a-3cc2-4610-9356-387836f77291 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:08.986857 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b4c7089a-3cc2-4610-9356-387836f77291 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:08.987287 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-b4c7089a-3cc2-4610-9356-387836f77291 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:09.175661 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-b4c7089a-3cc2-4610-9356-387836f77291 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:09.183559 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-b4c7089a-3cc2-4610-9356-387836f77291 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1577 microversion: 2.1 time: 0.212943 Nov 11 20:48:09.193421 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 805/1467] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:08 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1577 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:10.202590 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-69d45744-eb86-4ccc-bf3b-3ece37708e3b tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:10.203356 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-69d45744-eb86-4ccc-bf3b-3ece37708e3b tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:10.210196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-69d45744-eb86-4ccc-bf3b-3ece37708e3b tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:10.210750 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-69d45744-eb86-4ccc-bf3b-3ece37708e3b tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:10.211638 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-69d45744-eb86-4ccc-bf3b-3ece37708e3b tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:10.212216 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-69d45744-eb86-4ccc-bf3b-3ece37708e3b tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:10.388609 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-69d45744-eb86-4ccc-bf3b-3ece37708e3b tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:10.396696 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-69d45744-eb86-4ccc-bf3b-3ece37708e3b tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1577 microversion: 2.1 time: 0.198942 Nov 11 20:48:10.397343 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 663/1468] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:10 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1577 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:11.416342 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-368f5eec-b2d4-4018-82de-8677679934b1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:11.418582 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-368f5eec-b2d4-4018-82de-8677679934b1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:11.428548 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-368f5eec-b2d4-4018-82de-8677679934b1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:11.429240 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-368f5eec-b2d4-4018-82de-8677679934b1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:11.430820 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-368f5eec-b2d4-4018-82de-8677679934b1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:11.431425 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-368f5eec-b2d4-4018-82de-8677679934b1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:11.632082 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-368f5eec-b2d4-4018-82de-8677679934b1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:11.641267 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-368f5eec-b2d4-4018-82de-8677679934b1 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1564 microversion: 2.1 time: 0.229817 Nov 11 20:48:11.642030 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 806/1469] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:11 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1564 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:13.212715 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-14073515-b43a-4e31-9af6-a0018794f20a req-aeb4fa47-c20e-4a20-be64-55b836280c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a4baaf-615d-4da4-b61e-5a9199179627", "name": "network-vif-plugged", "status": "completed", "tag": "40bfc231-ecda-4dd7-a914-d4fd0a2d487b"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:48:13.214628 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:48:13.214628 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:48:13.223312 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-14073515-b43a-4e31-9af6-a0018794f20a req-aeb4fa47-c20e-4a20-be64-55b836280c3b service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:13.224072 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-14073515-b43a-4e31-9af6-a0018794f20a req-aeb4fa47-c20e-4a20-be64-55b836280c3b service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:13.236599 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-14073515-b43a-4e31-9af6-a0018794f20a req-aeb4fa47-c20e-4a20-be64-55b836280c3b service nova] Creating event network-vif-plugged:40bfc231-ecda-4dd7-a914-d4fd0a2d487b for instance c9a4baaf-615d-4da4-b61e-5a9199179627 on hv-cinder-81764 Nov 11 20:48:13.241847 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-14073515-b43a-4e31-9af6-a0018794f20a req-aeb4fa47-c20e-4a20-be64-55b836280c3b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033067 Nov 11 20:48:13.242835 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 664/1470] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:48:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:48:37.321045 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1410762322", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-897741008", "security_groups": [{"name": "tempest-secgroup-smoke-1070841398"}], "block_device_mapping_v2": [{"uuid": "8cb71a8a-a42e-4852-85f0-cd1264ecfb91", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79971f2e-5dd3-4116-8573-ccbb33e6422f"}]}} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:48:37.560659 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.network.neutron [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] validate_networks() for [('79971f2e-5dd3-4116-8573-ccbb33e6422f', None, None, None, None, None)] {{(pid=122526) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 11 20:48:37.975666 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Flavor limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 11 20:48:37.976350 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Image limits 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 11 20:48:37.976912 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Flavor pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 11 20:48:37.977327 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Image pref 0:0:0 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 11 20:48:37.977809 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.virt.hardware [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 11 20:48:37.987448 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:37.987883 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:37.988753 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:37.989188 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:38.007839 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Getting quotas for project 4dd611087eb441dc94ef8c18b6b7d600. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 11 20:48:38.011812 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.quota [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Getting quotas for user 32c40f3d5b074a22b2c48caef9230615 and project 4dd611087eb441dc94ef8c18b6b7d600. Resources: {'instances', 'cores', 'ram'} {{(pid=122526) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 11 20:48:38.071590 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Going to run 1 instances... {{(pid=122526) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 11 20:48:38.073772 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8cb71a8a-a42e-4852-85f0-cd1264ecfb91',volume_size=None,volume_type=None)] {{(pid=122526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 11 20:48:38.215528 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-0f430a92-fdf0-46e2-9944-e28fd8949c01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.898268 Nov 11 20:48:38.222876 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 807/1471] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Nov 11 20:48:37 2021] POST /compute/v2.1/servers => generated 406 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 11 20:48:38.228389 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-d6ceb19e-f0e2-4e49-a639-b25cacf2cccc tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:38.229856 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-d6ceb19e-f0e2-4e49-a639-b25cacf2cccc tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:38.422684 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-d6ceb19e-f0e2-4e49-a639-b25cacf2cccc tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:38.429879 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-d6ceb19e-f0e2-4e49-a639-b25cacf2cccc tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1094 microversion: 2.1 time: 0.205414 Nov 11 20:48:38.430439 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 665/1472] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:38 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1094 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:39.447348 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-83e11c51-8e1d-46e1-aa72-9e9c9a8c33f9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:39.448054 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-83e11c51-8e1d-46e1-aa72-9e9c9a8c33f9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:39.455152 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-83e11c51-8e1d-46e1-aa72-9e9c9a8c33f9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:39.456157 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-83e11c51-8e1d-46e1-aa72-9e9c9a8c33f9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:39.456476 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-83e11c51-8e1d-46e1-aa72-9e9c9a8c33f9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:39.456919 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-83e11c51-8e1d-46e1-aa72-9e9c9a8c33f9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:39.562349 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-83e11c51-8e1d-46e1-aa72-9e9c9a8c33f9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:39.569610 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-83e11c51-8e1d-46e1-aa72-9e9c9a8c33f9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1210 microversion: 2.1 time: 0.126895 Nov 11 20:48:39.570175 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 808/1473] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:39 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1210 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:40.586588 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-95354c48-239f-4be4-b15f-ca65262d41e9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:40.587188 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-95354c48-239f-4be4-b15f-ca65262d41e9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:40.595906 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-95354c48-239f-4be4-b15f-ca65262d41e9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:40.596332 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-95354c48-239f-4be4-b15f-ca65262d41e9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:40.597126 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-95354c48-239f-4be4-b15f-ca65262d41e9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:40.597999 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-95354c48-239f-4be4-b15f-ca65262d41e9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:40.807345 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-95354c48-239f-4be4-b15f-ca65262d41e9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:40.815513 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-95354c48-239f-4be4-b15f-ca65262d41e9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1266 microversion: 2.1 time: 0.232728 Nov 11 20:48:40.816139 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 666/1474] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:40 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:40.860437 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-898c57c0-9912-49ad-a2c8-4b32548effb4 req-4d83e730-565d-42b9-bee2-97e5df535c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1683ff3d-f65a-4bd6-83e5-bb007e0b0574", "tag": "504c9a9d-efca-49a6-be45-54542ff25747"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:48:40.861985 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:48:40.861985 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:48:40.871438 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-898c57c0-9912-49ad-a2c8-4b32548effb4 req-4d83e730-565d-42b9-bee2-97e5df535c56 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:40.871881 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-898c57c0-9912-49ad-a2c8-4b32548effb4 req-4d83e730-565d-42b9-bee2-97e5df535c56 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:40.893932 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-898c57c0-9912-49ad-a2c8-4b32548effb4 req-4d83e730-565d-42b9-bee2-97e5df535c56 service nova] Creating event network-changed:504c9a9d-efca-49a6-be45-54542ff25747 for instance 1683ff3d-f65a-4bd6-83e5-bb007e0b0574 on hv-cinder-81764 Nov 11 20:48:40.899240 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-898c57c0-9912-49ad-a2c8-4b32548effb4 req-4d83e730-565d-42b9-bee2-97e5df535c56 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043226 Nov 11 20:48:40.900255 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 809/1475] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:48:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:48:41.833436 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-15d5ac97-33c9-4287-bfbf-5da0f09d9d14 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:41.834042 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-15d5ac97-33c9-4287-bfbf-5da0f09d9d14 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:41.839882 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-15d5ac97-33c9-4287-bfbf-5da0f09d9d14 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:41.840359 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-15d5ac97-33c9-4287-bfbf-5da0f09d9d14 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:41.841137 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-15d5ac97-33c9-4287-bfbf-5da0f09d9d14 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:41.841569 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-15d5ac97-33c9-4287-bfbf-5da0f09d9d14 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:42.034206 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-15d5ac97-33c9-4287-bfbf-5da0f09d9d14 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:42.041950 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-15d5ac97-33c9-4287-bfbf-5da0f09d9d14 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1266 microversion: 2.1 time: 0.212291 Nov 11 20:48:42.051889 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 667/1476] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:41 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:43.059825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-5084ec9c-7349-412d-a8e1-5049d3f4214f tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:43.061198 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-5084ec9c-7349-412d-a8e1-5049d3f4214f tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:43.067597 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5084ec9c-7349-412d-a8e1-5049d3f4214f tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:43.068084 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5084ec9c-7349-412d-a8e1-5049d3f4214f tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:43.068872 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5084ec9c-7349-412d-a8e1-5049d3f4214f tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:43.069356 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-5084ec9c-7349-412d-a8e1-5049d3f4214f tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:43.211993 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-5084ec9c-7349-412d-a8e1-5049d3f4214f tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:43.220096 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-5084ec9c-7349-412d-a8e1-5049d3f4214f tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1266 microversion: 2.1 time: 0.164423 Nov 11 20:48:43.220675 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 810/1477] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:43 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:44.237602 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-3487fe88-ead5-46ae-9e4a-2e693ca721a9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:44.238239 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-3487fe88-ead5-46ae-9e4a-2e693ca721a9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:44.244454 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3487fe88-ead5-46ae-9e4a-2e693ca721a9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:44.244899 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3487fe88-ead5-46ae-9e4a-2e693ca721a9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:44.245669 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3487fe88-ead5-46ae-9e4a-2e693ca721a9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:44.246098 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-3487fe88-ead5-46ae-9e4a-2e693ca721a9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:44.381767 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-3487fe88-ead5-46ae-9e4a-2e693ca721a9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:44.389085 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-3487fe88-ead5-46ae-9e4a-2e693ca721a9 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1266 microversion: 2.1 time: 0.155087 Nov 11 20:48:44.389663 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 668/1478] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:44 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:48:45.406993 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-98942126-3be3-43c4-8686-c77cfe17d18a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:45.407599 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-98942126-3be3-43c4-8686-c77cfe17d18a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:45.413816 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-98942126-3be3-43c4-8686-c77cfe17d18a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:45.414263 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-98942126-3be3-43c4-8686-c77cfe17d18a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:45.415038 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-98942126-3be3-43c4-8686-c77cfe17d18a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:45.415472 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-98942126-3be3-43c4-8686-c77cfe17d18a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:45.552510 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-98942126-3be3-43c4-8686-c77cfe17d18a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:45.559801 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-98942126-3be3-43c4-8686-c77cfe17d18a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1266 microversion: 2.1 time: 0.157493 Nov 11 20:48:45.560435 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 811/1479] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:45 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:46.577804 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-471cef00-59bc-45bc-b5d4-e720a445a174 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:46.578427 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-471cef00-59bc-45bc-b5d4-e720a445a174 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:46.587199 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-471cef00-59bc-45bc-b5d4-e720a445a174 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:46.587766 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-471cef00-59bc-45bc-b5d4-e720a445a174 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:46.588687 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-471cef00-59bc-45bc-b5d4-e720a445a174 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:46.589207 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-471cef00-59bc-45bc-b5d4-e720a445a174 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:46.733023 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-471cef00-59bc-45bc-b5d4-e720a445a174 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:46.743095 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-471cef00-59bc-45bc-b5d4-e720a445a174 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1266 microversion: 2.1 time: 0.169339 Nov 11 20:48:46.743993 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 669/1480] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:46 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:47.760704 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-61bbc734-2e5d-4be8-a31d-9a783363e1e6 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:47.761328 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-61bbc734-2e5d-4be8-a31d-9a783363e1e6 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:47.768554 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61bbc734-2e5d-4be8-a31d-9a783363e1e6 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:47.769006 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61bbc734-2e5d-4be8-a31d-9a783363e1e6 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:47.769794 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61bbc734-2e5d-4be8-a31d-9a783363e1e6 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:47.770230 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-61bbc734-2e5d-4be8-a31d-9a783363e1e6 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:47.909758 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-61bbc734-2e5d-4be8-a31d-9a783363e1e6 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:47.918307 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-61bbc734-2e5d-4be8-a31d-9a783363e1e6 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1266 microversion: 2.1 time: 0.161200 Nov 11 20:48:47.918890 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 812/1481] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:47 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:48.936077 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-82835505-e7d0-4e2a-bd12-61b68187916b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:48.936623 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-82835505-e7d0-4e2a-bd12-61b68187916b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:48.943441 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-82835505-e7d0-4e2a-bd12-61b68187916b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:48.943890 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-82835505-e7d0-4e2a-bd12-61b68187916b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:48.944704 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-82835505-e7d0-4e2a-bd12-61b68187916b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:48.945128 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-82835505-e7d0-4e2a-bd12-61b68187916b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:49.083993 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-82835505-e7d0-4e2a-bd12-61b68187916b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:49.092263 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-82835505-e7d0-4e2a-bd12-61b68187916b tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1266 microversion: 2.1 time: 0.159221 Nov 11 20:48:49.092966 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 670/1482] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:48 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:50.110300 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-dadbaebb-bdfa-454b-bd83-1def586f7bcc tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:50.111059 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-dadbaebb-bdfa-454b-bd83-1def586f7bcc tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:50.116985 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dadbaebb-bdfa-454b-bd83-1def586f7bcc tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:50.117450 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dadbaebb-bdfa-454b-bd83-1def586f7bcc tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:50.118253 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dadbaebb-bdfa-454b-bd83-1def586f7bcc tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:50.118689 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-dadbaebb-bdfa-454b-bd83-1def586f7bcc tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:50.379933 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-dadbaebb-bdfa-454b-bd83-1def586f7bcc tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:50.387505 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-dadbaebb-bdfa-454b-bd83-1def586f7bcc tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1266 microversion: 2.1 time: 0.281143 Nov 11 20:48:50.388360 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 813/1483] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:50 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:51.405385 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2de83360-8fd3-450f-90f6-40bd755fd3c2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:51.406049 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2de83360-8fd3-450f-90f6-40bd755fd3c2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:51.413213 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2de83360-8fd3-450f-90f6-40bd755fd3c2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:51.413879 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2de83360-8fd3-450f-90f6-40bd755fd3c2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:51.414831 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2de83360-8fd3-450f-90f6-40bd755fd3c2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:51.415304 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2de83360-8fd3-450f-90f6-40bd755fd3c2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:51.415430 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-5325a128-25e1-4d37-a133-b318cd62e32b req-b06955b4-3c2f-4c62-9085-61c9aecbd14b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1683ff3d-f65a-4bd6-83e5-bb007e0b0574", "name": "network-vif-plugged", "status": "completed", "tag": "504c9a9d-efca-49a6-be45-54542ff25747"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:48:51.417781 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:48:51.417781 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:48:51.428073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-5325a128-25e1-4d37-a133-b318cd62e32b req-b06955b4-3c2f-4c62-9085-61c9aecbd14b service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:51.428916 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-5325a128-25e1-4d37-a133-b318cd62e32b req-b06955b4-3c2f-4c62-9085-61c9aecbd14b service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:51.456677 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-5325a128-25e1-4d37-a133-b318cd62e32b req-b06955b4-3c2f-4c62-9085-61c9aecbd14b service nova] Creating event network-vif-plugged:504c9a9d-efca-49a6-be45-54542ff25747 for instance 1683ff3d-f65a-4bd6-83e5-bb007e0b0574 on hv-cinder-81764 Nov 11 20:48:51.463410 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-5325a128-25e1-4d37-a133-b318cd62e32b req-b06955b4-3c2f-4c62-9085-61c9aecbd14b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052747 Nov 11 20:48:51.464194 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 814/1484] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:48:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:48:51.566801 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-2de83360-8fd3-450f-90f6-40bd755fd3c2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:51.574134 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2de83360-8fd3-450f-90f6-40bd755fd3c2 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1266 microversion: 2.1 time: 0.173424 Nov 11 20:48:51.574700 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 671/1485] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:51 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:48:52.592886 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-d666ca98-b286-4f38-ab07-f77980948822 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:52.593580 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-d666ca98-b286-4f38-ab07-f77980948822 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:52.600728 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d666ca98-b286-4f38-ab07-f77980948822 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:52.601254 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d666ca98-b286-4f38-ab07-f77980948822 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:52.602118 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d666ca98-b286-4f38-ab07-f77980948822 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:52.602640 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-d666ca98-b286-4f38-ab07-f77980948822 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:52.748519 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-d666ca98-b286-4f38-ab07-f77980948822 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:52.755682 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-d666ca98-b286-4f38-ab07-f77980948822 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1266 microversion: 2.1 time: 0.167541 Nov 11 20:48:52.756477 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 815/1486] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:52 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:53.772791 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-11387801-e905-4954-ad31-88d15e72ab7e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:53.773385 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-11387801-e905-4954-ad31-88d15e72ab7e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:53.780108 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-11387801-e905-4954-ad31-88d15e72ab7e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:53.780561 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-11387801-e905-4954-ad31-88d15e72ab7e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:53.781339 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-11387801-e905-4954-ad31-88d15e72ab7e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:53.781775 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-11387801-e905-4954-ad31-88d15e72ab7e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:53.915626 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-11387801-e905-4954-ad31-88d15e72ab7e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:53.923519 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-11387801-e905-4954-ad31-88d15e72ab7e tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1454 microversion: 2.1 time: 0.154298 Nov 11 20:48:53.924122 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 672/1487] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:53 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:48:53.940709 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-9bcd998f-2b42-428c-831c-07a7a5383528 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:48:53.941912 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-9bcd998f-2b42-428c-831c-07a7a5383528 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:48:53.948563 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9bcd998f-2b42-428c-831c-07a7a5383528 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:53.949007 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9bcd998f-2b42-428c-831c-07a7a5383528 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:53.949783 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9bcd998f-2b42-428c-831c-07a7a5383528 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:53.950211 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-9bcd998f-2b42-428c-831c-07a7a5383528 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:54.090312 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-9bcd998f-2b42-428c-831c-07a7a5383528 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:48:54.098852 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-9bcd998f-2b42-428c-831c-07a7a5383528 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1454 microversion: 2.1 time: 0.161627 Nov 11 20:48:54.099564 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 816/1488] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:48:53 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:48:56.091096 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-b299ee98-db76-4bba-a789-1cdd255f2b21 req-3e67b960-1d2a-4f63-873d-50ff5c2554b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1683ff3d-f65a-4bd6-83e5-bb007e0b0574", "tag": "504c9a9d-efca-49a6-be45-54542ff25747"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:48:56.093280 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:48:56.093280 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:48:56.101692 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-b299ee98-db76-4bba-a789-1cdd255f2b21 req-3e67b960-1d2a-4f63-873d-50ff5c2554b5 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:48:56.102308 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-b299ee98-db76-4bba-a789-1cdd255f2b21 req-3e67b960-1d2a-4f63-873d-50ff5c2554b5 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:48:56.114645 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-b299ee98-db76-4bba-a789-1cdd255f2b21 req-3e67b960-1d2a-4f63-873d-50ff5c2554b5 service nova] Creating event network-changed:504c9a9d-efca-49a6-be45-54542ff25747 for instance 1683ff3d-f65a-4bd6-83e5-bb007e0b0574 on hv-cinder-81764 Nov 11 20:48:56.122596 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-b299ee98-db76-4bba-a789-1cdd255f2b21 req-3e67b960-1d2a-4f63-873d-50ff5c2554b5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035052 Nov 11 20:48:56.123772 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 673/1489] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:48:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:49:42.381920 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-a6f247ad-dd56-4125-b878-4260bcc37a72 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:49:42.382458 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a6f247ad-dd56-4125-b878-4260bcc37a72 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:49:42.389260 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a6f247ad-dd56-4125-b878-4260bcc37a72 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:42.389709 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a6f247ad-dd56-4125-b878-4260bcc37a72 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:42.390698 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a6f247ad-dd56-4125-b878-4260bcc37a72 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:42.391138 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-a6f247ad-dd56-4125-b878-4260bcc37a72 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:42.417829 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-a6f247ad-dd56-4125-b878-4260bcc37a72 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Going to try to terminate instance {{(pid=122526) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:49:42.499360 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-a6f247ad-dd56-4125-b878-4260bcc37a72 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 204 len: 0 microversion: 2.1 time: 0.120849 Nov 11 20:49:42.502013 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 817/1490] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:49:42 2021] DELETE /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:49:42.509647 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e1369237-642a-4b42-962d-74b0129d3151 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:49:42.510362 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e1369237-642a-4b42-962d-74b0129d3151 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:49:42.517963 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e1369237-642a-4b42-962d-74b0129d3151 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:42.518506 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e1369237-642a-4b42-962d-74b0129d3151 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:42.519390 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e1369237-642a-4b42-962d-74b0129d3151 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:42.519902 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e1369237-642a-4b42-962d-74b0129d3151 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:42.555749 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-f52a3303-21a9-469e-8b92-430511469748 req-843bc096-c79c-4434-97e4-b197cb33f20f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a4baaf-615d-4da4-b61e-5a9199179627", "tag": "40bfc231-ecda-4dd7-a914-d4fd0a2d487b"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:49:42.557648 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:49:42.557648 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:49:42.565367 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-f52a3303-21a9-469e-8b92-430511469748 req-843bc096-c79c-4434-97e4-b197cb33f20f service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:42.565888 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-f52a3303-21a9-469e-8b92-430511469748 req-843bc096-c79c-4434-97e4-b197cb33f20f service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:42.578208 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-f52a3303-21a9-469e-8b92-430511469748 req-843bc096-c79c-4434-97e4-b197cb33f20f service nova] Creating event network-changed:40bfc231-ecda-4dd7-a914-d4fd0a2d487b for instance c9a4baaf-615d-4da4-b61e-5a9199179627 on hv-cinder-81764 Nov 11 20:49:42.583649 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-f52a3303-21a9-469e-8b92-430511469748 req-843bc096-c79c-4434-97e4-b197cb33f20f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202490 Nov 11 20:49:42.584560 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 674/1491] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:49:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:49:42.693272 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e1369237-642a-4b42-962d-74b0129d3151 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:49:42.701698 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e1369237-642a-4b42-962d-74b0129d3151 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1570 microversion: 2.1 time: 0.196519 Nov 11 20:49:42.702284 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 818/1492] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:49:42 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 11 20:49:43.721281 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-e22ebdb9-91a8-4247-8853-920ea9db5584 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:49:43.721881 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-e22ebdb9-91a8-4247-8853-920ea9db5584 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:49:43.728628 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e22ebdb9-91a8-4247-8853-920ea9db5584 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:43.729079 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e22ebdb9-91a8-4247-8853-920ea9db5584 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:43.729999 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e22ebdb9-91a8-4247-8853-920ea9db5584 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:43.730417 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-e22ebdb9-91a8-4247-8853-920ea9db5584 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:43.862761 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-e22ebdb9-91a8-4247-8853-920ea9db5584 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:49:43.871061 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-e22ebdb9-91a8-4247-8853-920ea9db5584 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1451 microversion: 2.1 time: 0.153815 Nov 11 20:49:43.871620 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 675/1493] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:49:43 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:49:44.888577 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-28abb1a6-607f-41a9-9a0a-6af574b2f273 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:49:44.889275 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-28abb1a6-607f-41a9-9a0a-6af574b2f273 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:49:44.895750 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-28abb1a6-607f-41a9-9a0a-6af574b2f273 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:44.896339 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-28abb1a6-607f-41a9-9a0a-6af574b2f273 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:44.897133 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-28abb1a6-607f-41a9-9a0a-6af574b2f273 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:44.897562 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-28abb1a6-607f-41a9-9a0a-6af574b2f273 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:45.339544 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-28abb1a6-607f-41a9-9a0a-6af574b2f273 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:49:45.347201 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-28abb1a6-607f-41a9-9a0a-6af574b2f273 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1451 microversion: 2.1 time: 0.462679 Nov 11 20:49:45.348022 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 819/1494] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:49:44 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1451 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:49:45.581397 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-3ea43980-ccb8-4696-9ee8-80d4e316741a req-f92fc23e-6ddc-4a3a-a170-108c3406346a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a4baaf-615d-4da4-b61e-5a9199179627", "name": "network-vif-deleted", "tag": "40bfc231-ecda-4dd7-a914-d4fd0a2d487b"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:49:45.582884 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:49:45.582884 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:49:45.591311 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-3ea43980-ccb8-4696-9ee8-80d4e316741a req-f92fc23e-6ddc-4a3a-a170-108c3406346a service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:45.591817 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-3ea43980-ccb8-4696-9ee8-80d4e316741a req-f92fc23e-6ddc-4a3a-a170-108c3406346a service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:45.606941 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-3ea43980-ccb8-4696-9ee8-80d4e316741a req-f92fc23e-6ddc-4a3a-a170-108c3406346a service nova] Creating event network-vif-deleted:40bfc231-ecda-4dd7-a914-d4fd0a2d487b for instance c9a4baaf-615d-4da4-b61e-5a9199179627 on hv-cinder-81764 Nov 11 20:49:45.611725 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-3ea43980-ccb8-4696-9ee8-80d4e316741a req-f92fc23e-6ddc-4a3a-a170-108c3406346a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033963 Nov 11 20:49:45.612344 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 676/1495] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:49:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:49:46.364445 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-e5e60b1c-307f-4ab7-be43-a4e3503a0432 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:49:46.365064 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-e5e60b1c-307f-4ab7-be43-a4e3503a0432 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:49:46.371985 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5e60b1c-307f-4ab7-be43-a4e3503a0432 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:46.372448 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5e60b1c-307f-4ab7-be43-a4e3503a0432 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:46.373262 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5e60b1c-307f-4ab7-be43-a4e3503a0432 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:46.373723 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5e60b1c-307f-4ab7-be43-a4e3503a0432 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:46.403913 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5e60b1c-307f-4ab7-be43-a4e3503a0432 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:46.404379 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-e5e60b1c-307f-4ab7-be43-a4e3503a0432 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:46.404825 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.objects.instance [None req-e5e60b1c-307f-4ab7-be43-a4e3503a0432 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lazy-loading 'fault' on Instance uuid c9a4baaf-615d-4da4-b61e-5a9199179627 {{(pid=122526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 11 20:49:46.449046 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-e5e60b1c-307f-4ab7-be43-a4e3503a0432 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04ea153f3a44236a3cc29bb26dcacbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad6c752ea6048068ad66bddb0f2968f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:49:46.457178 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-e5e60b1c-307f-4ab7-be43-a4e3503a0432 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 200 len: 1224 microversion: 2.1 time: 0.096513 Nov 11 20:49:46.457765 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 820/1496] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:49:46 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:49:47.476052 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f09e8d85-60f8-4e7f-8f35-9fbc06a4957c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:49:47.476740 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-f09e8d85-60f8-4e7f-8f35-9fbc06a4957c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] [instance: c9a4baaf-615d-4da4-b61e-5a9199179627] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:49:47.483267 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f09e8d85-60f8-4e7f-8f35-9fbc06a4957c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:47.483707 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f09e8d85-60f8-4e7f-8f35-9fbc06a4957c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:47.484501 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f09e8d85-60f8-4e7f-8f35-9fbc06a4957c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:49:47.484930 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-f09e8d85-60f8-4e7f-8f35-9fbc06a4957c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:49:47.498357 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-f09e8d85-60f8-4e7f-8f35-9fbc06a4957c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] HTTP exception thrown: Instance c9a4baaf-615d-4da4-b61e-5a9199179627 could not be found. Nov 11 20:49:47.498948 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-f09e8d85-60f8-4e7f-8f35-9fbc06a4957c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Returning 404 to user: Instance c9a4baaf-615d-4da4-b61e-5a9199179627 could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:49:47.499772 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-f09e8d85-60f8-4e7f-8f35-9fbc06a4957c tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627" status: 404 len: 111 microversion: 2.1 time: 0.028625 Nov 11 20:49:47.500350 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 677/1497] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:49:47 2021] GET /compute/v2.1/servers/c9a4baaf-615d-4da4-b61e-5a9199179627 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:49:47.656467 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-ffb88674-56c4-4786-b407-3f5afe8a2d90 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] Calling method '.version_select at 0x7ff3edae5820>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:49:47.676947 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-ffb88674-56c4-4786-b407-3f5afe8a2d90 tempest-TestShelveInstance-1533368909 tempest-TestShelveInstance-1533368909-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1324740347" status: 202 len: 0 microversion: 2.1 time: 0.024168 Nov 11 20:49:47.677526 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 821/1498] 10.222.0.61 () {58 vars in 1253 bytes} [Thu Nov 11 20:49:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1324740347 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:49:59.551066 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 20:49:59.551694 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: Thu Nov 11 20:49:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 20:50:36.581276 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-2af106e1-40b3-4ebd-ac13-fa97e750c29d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:36.581925 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2af106e1-40b3-4ebd-ac13-fa97e750c29d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:50:36.588638 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2af106e1-40b3-4ebd-ac13-fa97e750c29d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:36.589285 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2af106e1-40b3-4ebd-ac13-fa97e750c29d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:36.590079 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2af106e1-40b3-4ebd-ac13-fa97e750c29d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:36.590513 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-2af106e1-40b3-4ebd-ac13-fa97e750c29d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:36.616728 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-2af106e1-40b3-4ebd-ac13-fa97e750c29d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Going to try to terminate instance {{(pid=122527) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:50:36.698632 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-2af106e1-40b3-4ebd-ac13-fa97e750c29d tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 204 len: 0 microversion: 2.1 time: 0.120314 Nov 11 20:50:36.702140 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 678/1499] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:50:36 2021] DELETE /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:50:36.709990 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-8dc144f4-d507-43a7-9337-4baac0fed521 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:36.710738 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-8dc144f4-d507-43a7-9337-4baac0fed521 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:50:36.717698 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8dc144f4-d507-43a7-9337-4baac0fed521 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:36.718130 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8dc144f4-d507-43a7-9337-4baac0fed521 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:36.720016 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8dc144f4-d507-43a7-9337-4baac0fed521 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:36.720016 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-8dc144f4-d507-43a7-9337-4baac0fed521 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:36.780804 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-26a7d3da-a933-4779-86dc-f73a03e70874 req-969fc270-5ec5-42bf-abc6-af05a3f98938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1683ff3d-f65a-4bd6-83e5-bb007e0b0574", "tag": "504c9a9d-efca-49a6-be45-54542ff25747"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:50:36.783177 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:50:36.783177 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:50:36.790315 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-26a7d3da-a933-4779-86dc-f73a03e70874 req-969fc270-5ec5-42bf-abc6-af05a3f98938 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:36.791368 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-26a7d3da-a933-4779-86dc-f73a03e70874 req-969fc270-5ec5-42bf-abc6-af05a3f98938 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:36.802820 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-26a7d3da-a933-4779-86dc-f73a03e70874 req-969fc270-5ec5-42bf-abc6-af05a3f98938 service nova] Creating event network-changed:504c9a9d-efca-49a6-be45-54542ff25747 for instance 1683ff3d-f65a-4bd6-83e5-bb007e0b0574 on hv-cinder-81764 Nov 11 20:50:36.808672 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-26a7d3da-a933-4779-86dc-f73a03e70874 req-969fc270-5ec5-42bf-abc6-af05a3f98938 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228523 Nov 11 20:50:36.809683 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 822/1500] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:50:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:50:36.893502 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-8dc144f4-d507-43a7-9337-4baac0fed521 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:50:36.902726 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-8dc144f4-d507-43a7-9337-4baac0fed521 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1578 microversion: 2.1 time: 0.198403 Nov 11 20:50:36.904019 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 679/1501] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:50:36 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1578 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:50:37.921762 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-8abb2cdf-1e7f-41f3-8085-3417b28e4a6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:37.922487 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-8abb2cdf-1e7f-41f3-8085-3417b28e4a6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:50:37.928689 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8abb2cdf-1e7f-41f3-8085-3417b28e4a6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:37.929142 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8abb2cdf-1e7f-41f3-8085-3417b28e4a6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:37.929923 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8abb2cdf-1e7f-41f3-8085-3417b28e4a6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:37.930361 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-8abb2cdf-1e7f-41f3-8085-3417b28e4a6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:38.067352 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-8abb2cdf-1e7f-41f3-8085-3417b28e4a6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:50:38.075668 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-8abb2cdf-1e7f-41f3-8085-3417b28e4a6a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1460 microversion: 2.1 time: 0.158389 Nov 11 20:50:38.076276 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 823/1502] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:50:37 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1460 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:50:39.093385 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-182606ea-5da2-402e-b45a-eac397a75079 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:39.093996 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-182606ea-5da2-402e-b45a-eac397a75079 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:50:39.100788 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-182606ea-5da2-402e-b45a-eac397a75079 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:39.101256 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-182606ea-5da2-402e-b45a-eac397a75079 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:39.102087 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-182606ea-5da2-402e-b45a-eac397a75079 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:39.102513 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-182606ea-5da2-402e-b45a-eac397a75079 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:39.107151 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-364314fc-0b0d-4924-bdde-9c23f863fa85 req-53dcab8a-963f-4e0b-965c-4250ff36ded7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1683ff3d-f65a-4bd6-83e5-bb007e0b0574", "name": "network-vif-deleted", "tag": "504c9a9d-efca-49a6-be45-54542ff25747"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:50:39.108696 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:50:39.108696 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:50:39.116408 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-364314fc-0b0d-4924-bdde-9c23f863fa85 req-53dcab8a-963f-4e0b-965c-4250ff36ded7 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:39.116848 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-364314fc-0b0d-4924-bdde-9c23f863fa85 req-53dcab8a-963f-4e0b-965c-4250ff36ded7 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:39.128785 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-364314fc-0b0d-4924-bdde-9c23f863fa85 req-53dcab8a-963f-4e0b-965c-4250ff36ded7 service nova] Creating event network-vif-deleted:504c9a9d-efca-49a6-be45-54542ff25747 for instance 1683ff3d-f65a-4bd6-83e5-bb007e0b0574 on hv-cinder-81764 Nov 11 20:50:39.133694 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-364314fc-0b0d-4924-bdde-9c23f863fa85 req-53dcab8a-963f-4e0b-965c-4250ff36ded7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030525 Nov 11 20:50:39.135361 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 824/1503] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:50:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:50:39.170670 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-182606ea-5da2-402e-b45a-eac397a75079 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:50:39.178220 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-182606ea-5da2-402e-b45a-eac397a75079 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 200 len: 1392 microversion: 2.1 time: 0.088469 Nov 11 20:50:39.178865 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 680/1504] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:50:39 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 1392 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:50:40.196138 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2c2b2574-b244-4af4-84fc-78cc96fc43f3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:40.196865 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-2c2b2574-b244-4af4-84fc-78cc96fc43f3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1683ff3d-f65a-4bd6-83e5-bb007e0b0574] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:50:40.205274 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2c2b2574-b244-4af4-84fc-78cc96fc43f3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:40.205716 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2c2b2574-b244-4af4-84fc-78cc96fc43f3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:40.206501 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2c2b2574-b244-4af4-84fc-78cc96fc43f3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:40.206929 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-2c2b2574-b244-4af4-84fc-78cc96fc43f3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:40.223169 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-2c2b2574-b244-4af4-84fc-78cc96fc43f3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] HTTP exception thrown: Instance 1683ff3d-f65a-4bd6-83e5-bb007e0b0574 could not be found. Nov 11 20:50:40.223753 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-2c2b2574-b244-4af4-84fc-78cc96fc43f3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Returning 404 to user: Instance 1683ff3d-f65a-4bd6-83e5-bb007e0b0574 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:50:40.224689 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-2c2b2574-b244-4af4-84fc-78cc96fc43f3 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574" status: 404 len: 111 microversion: 2.1 time: 0.033216 Nov 11 20:50:40.225250 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 825/1505] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:50:40 2021] GET /compute/v2.1/servers/1683ff3d-f65a-4bd6-83e5-bb007e0b0574 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:50:43.263438 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-dd8fe88b-fee7-4fe9-8ba2-d292588c31ef tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:43.264613 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-dd8fe88b-fee7-4fe9-8ba2-d292588c31ef tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:50:43.266117 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [req-71ddf68b-97da-4926-8916-bc8dd0961aa7 req-41272363-83c9-4e4d-8c18-ccb5748d416c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80e4bb44-7412-4d18-9df5-940938029647", "tag": "f2b2c706-9af8-45b8-bde7-b4119bd30e56"}]} {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:50:43.267898 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:50:43.267898 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: warnings.warn(msg) Nov 11 20:50:43.270780 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dd8fe88b-fee7-4fe9-8ba2-d292588c31ef tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:43.271230 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dd8fe88b-fee7-4fe9-8ba2-d292588c31ef tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:43.272029 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dd8fe88b-fee7-4fe9-8ba2-d292588c31ef tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:43.272460 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-dd8fe88b-fee7-4fe9-8ba2-d292588c31ef tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:43.276306 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-71ddf68b-97da-4926-8916-bc8dd0961aa7 req-41272363-83c9-4e4d-8c18-ccb5748d416c service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:43.276715 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [req-71ddf68b-97da-4926-8916-bc8dd0961aa7 req-41272363-83c9-4e4d-8c18-ccb5748d416c service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:43.289563 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.compute.server_external_events [req-71ddf68b-97da-4926-8916-bc8dd0961aa7 req-41272363-83c9-4e4d-8c18-ccb5748d416c service nova] Creating event network-changed:f2b2c706-9af8-45b8-bde7-b4119bd30e56 for instance 80e4bb44-7412-4d18-9df5-940938029647 on hv-cinder-81764 Nov 11 20:50:43.295689 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [req-71ddf68b-97da-4926-8916-bc8dd0961aa7 req-41272363-83c9-4e4d-8c18-ccb5748d416c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033295 Nov 11 20:50:43.296331 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 826/1506] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:50:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 11 20:50:43.302047 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-dd8fe88b-fee7-4fe9-8ba2-d292588c31ef tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Going to try to terminate instance {{(pid=122527) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 11 20:50:43.382793 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-dd8fe88b-fee7-4fe9-8ba2-d292588c31ef tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "DELETE /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 204 len: 0 microversion: 2.1 time: 0.123162 Nov 11 20:50:43.383759 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 681/1507] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:50:43 2021] DELETE /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 11 20:50:43.392933 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-80de9a4f-b52e-4503-acfc-218595fbb74a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:43.393630 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-80de9a4f-b52e-4503-acfc-218595fbb74a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:50:43.400900 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-80de9a4f-b52e-4503-acfc-218595fbb74a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:43.401339 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-80de9a4f-b52e-4503-acfc-218595fbb74a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:43.402358 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-80de9a4f-b52e-4503-acfc-218595fbb74a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:43.402783 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-80de9a4f-b52e-4503-acfc-218595fbb74a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:43.626856 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-80de9a4f-b52e-4503-acfc-218595fbb74a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:50:43.634927 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-80de9a4f-b52e-4503-acfc-218595fbb74a tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1575 microversion: 2.1 time: 0.245671 Nov 11 20:50:43.635504 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 827/1508] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:50:43 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1575 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:50:44.653371 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-04b2d1df-982f-466a-bb44-d5a7252afe28 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:44.653981 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-04b2d1df-982f-466a-bb44-d5a7252afe28 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:50:44.660271 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-04b2d1df-982f-466a-bb44-d5a7252afe28 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:44.660718 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-04b2d1df-982f-466a-bb44-d5a7252afe28 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:44.661549 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-04b2d1df-982f-466a-bb44-d5a7252afe28 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:44.661931 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-04b2d1df-982f-466a-bb44-d5a7252afe28 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:44.794740 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.policy [None req-04b2d1df-982f-466a-bb44-d5a7252afe28 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122527) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:50:44.802027 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-04b2d1df-982f-466a-bb44-d5a7252afe28 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1458 microversion: 2.1 time: 0.153508 Nov 11 20:50:44.802574 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 682/1509] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:50:44 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1458 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:50:45.819161 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-bdf87450-cbd5-47ea-bb05-516cbb1028cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:45.819791 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-bdf87450-cbd5-47ea-bb05-516cbb1028cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:50:45.826293 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bdf87450-cbd5-47ea-bb05-516cbb1028cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:45.826737 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bdf87450-cbd5-47ea-bb05-516cbb1028cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:45.827515 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bdf87450-cbd5-47ea-bb05-516cbb1028cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:45.828083 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-bdf87450-cbd5-47ea-bb05-516cbb1028cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:45.907374 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.policy [None req-bdf87450-cbd5-47ea-bb05-516cbb1028cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32c40f3d5b074a22b2c48caef9230615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd611087eb441dc94ef8c18b6b7d600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122526) authorize /opt/stack/nova/nova/policy.py:199}} Nov 11 20:50:45.916899 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-bdf87450-cbd5-47ea-bb05-516cbb1028cd tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 200 len: 1390 microversion: 2.1 time: 0.101132 Nov 11 20:50:45.917578 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 828/1510] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:50:45 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 1390 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 11 20:50:45.919799 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [req-c0aea9aa-a9b8-44da-ba1b-f03558d97b27 req-0fda2a97-ffdd-4723-b7e9-b2067b857192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80e4bb44-7412-4d18-9df5-940938029647", "name": "network-vif-deleted", "tag": "f2b2c706-9af8-45b8-bde7-b4119bd30e56"}]} {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 11 20:50:45.921674 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 11 20:50:45.921674 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: warnings.warn(msg) Nov 11 20:50:45.929498 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-c0aea9aa-a9b8-44da-ba1b-f03558d97b27 req-0fda2a97-ffdd-4723-b7e9-b2067b857192 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:45.930000 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [req-c0aea9aa-a9b8-44da-ba1b-f03558d97b27 req-0fda2a97-ffdd-4723-b7e9-b2067b857192 service nova] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:45.941847 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.compute.server_external_events [req-c0aea9aa-a9b8-44da-ba1b-f03558d97b27 req-0fda2a97-ffdd-4723-b7e9-b2067b857192 service nova] Creating event network-vif-deleted:f2b2c706-9af8-45b8-bde7-b4119bd30e56 for instance 80e4bb44-7412-4d18-9df5-940938029647 on hv-cinder-81764 Nov 11 20:50:45.946842 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [req-c0aea9aa-a9b8-44da-ba1b-f03558d97b27 req-0fda2a97-ffdd-4723-b7e9-b2067b857192 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032122 Nov 11 20:50:45.947492 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 683/1511] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Nov 11 20:50:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 11 20:50:46.935234 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cec4af0f-e047-4c47-97ef-38bb1f64fec8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:46.935860 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-cec4af0f-e047-4c47-97ef-38bb1f64fec8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 80e4bb44-7412-4d18-9df5-940938029647] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:50:46.942251 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cec4af0f-e047-4c47-97ef-38bb1f64fec8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:46.942693 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cec4af0f-e047-4c47-97ef-38bb1f64fec8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:46.943456 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cec4af0f-e047-4c47-97ef-38bb1f64fec8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:46.943912 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-cec4af0f-e047-4c47-97ef-38bb1f64fec8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:46.957418 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-cec4af0f-e047-4c47-97ef-38bb1f64fec8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] HTTP exception thrown: Instance 80e4bb44-7412-4d18-9df5-940938029647 could not be found. Nov 11 20:50:46.958000 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-cec4af0f-e047-4c47-97ef-38bb1f64fec8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Returning 404 to user: Instance 80e4bb44-7412-4d18-9df5-940938029647 could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:50:46.958850 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-cec4af0f-e047-4c47-97ef-38bb1f64fec8 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647" status: 404 len: 111 microversion: 2.1 time: 0.028137 Nov 11 20:50:46.959379 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 829/1512] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:50:46 2021] GET /compute/v2.1/servers/80e4bb44-7412-4d18-9df5-940938029647 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:50:47.400587 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b5b0eee2-51f9-4567-8404-46de7bb09b01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:47.401182 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.compute.api [None req-b5b0eee2-51f9-4567-8404-46de7bb09b01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122527) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:50:47.407747 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b5b0eee2-51f9-4567-8404-46de7bb09b01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:47.408229 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b5b0eee2-51f9-4567-8404-46de7bb09b01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:47.409006 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b5b0eee2-51f9-4567-8404-46de7bb09b01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:47.409440 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG oslo_concurrency.lockutils [None req-b5b0eee2-51f9-4567-8404-46de7bb09b01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122527) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:47.422666 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.wsgi [None req-b5b0eee2-51f9-4567-8404-46de7bb09b01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] HTTP exception thrown: Instance 1a6650f0-499e-492c-bb9f-6424e765a81b could not be found. Nov 11 20:50:47.423245 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-b5b0eee2-51f9-4567-8404-46de7bb09b01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Returning 404 to user: Instance 1a6650f0-499e-492c-bb9f-6424e765a81b could not be found. {{(pid=122527) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:50:47.424090 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-b5b0eee2-51f9-4567-8404-46de7bb09b01 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 404 len: 111 microversion: 2.1 time: 0.028308 Nov 11 20:50:47.424624 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 684/1513] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Nov 11 20:50:47 2021] DELETE /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:50:47.433434 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-af3be32e-2807-4a87-a5fe-328137a42ea0 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '>' {{(pid=122526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:47.434049 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.compute.api [None req-af3be32e-2807-4a87-a5fe-328137a42ea0 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] [instance: 1a6650f0-499e-492c-bb9f-6424e765a81b] Fetching instance by UUID {{(pid=122526) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 11 20:50:47.439889 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af3be32e-2807-4a87-a5fe-328137a42ea0 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:47.440377 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af3be32e-2807-4a87-a5fe-328137a42ea0 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:47.441162 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af3be32e-2807-4a87-a5fe-328137a42ea0 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 11 20:50:47.441600 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG oslo_concurrency.lockutils [None req-af3be32e-2807-4a87-a5fe-328137a42ea0 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Lock "1f28bff3-30b2-4836-a432-daa68ea6bc82" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 11 20:50:47.454631 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.wsgi [None req-af3be32e-2807-4a87-a5fe-328137a42ea0 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] HTTP exception thrown: Instance 1a6650f0-499e-492c-bb9f-6424e765a81b could not be found. Nov 11 20:50:47.455215 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: DEBUG nova.api.openstack.wsgi [None req-af3be32e-2807-4a87-a5fe-328137a42ea0 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Returning 404 to user: Instance 1a6650f0-499e-492c-bb9f-6424e765a81b could not be found. {{(pid=122526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 11 20:50:47.456073 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO nova.api.openstack.requestlog [None req-af3be32e-2807-4a87-a5fe-328137a42ea0 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b" status: 404 len: 111 microversion: 2.1 time: 0.027057 Nov 11 20:50:47.456635 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: [pid: 122526|app: 0|req: 830/1514] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Nov 11 20:50:47 2021] GET /compute/v2.1/servers/1a6650f0-499e-492c-bb9f-6424e765a81b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 11 20:50:48.734046 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: DEBUG nova.api.openstack.wsgi [None req-47633fcf-2406-4038-a238-5db0a8505c86 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] Calling method '.version_select at 0x7ff3f2ab6af0>' {{(pid=122527) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 11 20:50:48.754467 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO nova.api.openstack.requestlog [None req-47633fcf-2406-4038-a238-5db0a8505c86 tempest-TestVolumeBootPattern-1710706643 tempest-TestVolumeBootPattern-1710706643-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-897741008" status: 202 len: 0 microversion: 2.1 time: 0.024092 Nov 11 20:50:48.755051 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: [pid: 122527|app: 0|req: 685/1515] 10.222.0.61 () {58 vars in 1259 bytes} [Thu Nov 11 20:50:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-897741008 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 11 20:51:39.182330 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 20:51:39.182944 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: Thu Nov 11 20:51:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 20:52:55.991898 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 20:52:55.992608 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: Thu Nov 11 20:52:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 20:53:19.569196 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 20:53:19.569836 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: Thu Nov 11 20:53:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 20:53:46.369795 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 20:53:46.370504 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: Thu Nov 11 20:53:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 20:53:48.488956 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 20:53:48.489546 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: Thu Nov 11 20:53:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 20:54:59.200520 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 20:54:59.201295 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: Thu Nov 11 20:54:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 20:56:16.010063 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 20:56:16.010683 dv-cinder-817642-1-iscsi devstack@n-api.service[122526]: Thu Nov 11 20:56:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 20:56:39.587621 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 20:56:39.588275 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: Thu Nov 11 20:56:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 11 20:56:43.554969 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 11 20:56:43.555671 dv-cinder-817642-1-iscsi devstack@n-api.service[122527]: Thu Nov 11 20:56:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!